Nov 16 15:12:49 user nova-compute[74658]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74658) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 15:12:49 user nova-compute[74658]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74658) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 15:12:49 user nova-compute[74658]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74658) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 15:12:49 user nova-compute[74658]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:12:50 user nova-compute[74658]: INFO nova.virt.driver [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 16 15:12:50 user nova-compute[74658]: INFO nova.compute.provider_config [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] Acquiring lock "singleton_lock" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] Acquired lock "singleton_lock" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] Releasing lock "singleton_lock" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] Full set of CONF: {{(pid=74658) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ******************************************************************************** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] Configuration options gathered from: {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ================================================================================ {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] allow_resize_to_same_host      = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] arq_binding_timeout            = 300 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] backdoor_port                  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] backdoor_socket                = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] block_device_allocate_retries  = 300 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] block_device_allocate_retries_interval = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cert                           = self.pem {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute_monitors               = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] config_dir                     = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] config_drive_format            = iso9660 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] config_source                  = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] console_host                   = user {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] control_exchange               = nova {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cpu_allocation_ratio           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] daemon                         = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] debug                          = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] default_access_ip_network_name = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] default_availability_zone      = nova {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] default_ephemeral_format       = ext4 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] default_green_pool_size        = 1000 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] default_schedule_zone          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] disk_allocation_ratio          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] enable_new_services            = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] enabled_ssl_apis               = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] flat_injected                  = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] force_config_drive             = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] force_raw_images               = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] graceful_shutdown_timeout      = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] heal_instance_info_cache_interval = 60 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] host                           = user {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] instance_build_timeout         = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] instance_delete_interval       = 300 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] instance_name_template         = instance-%08x {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] instance_usage_audit           = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] instance_usage_audit_period    = month {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] internal_service_availability_zone = internal {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] key                            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] live_migration_retry_count     = 30 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] log_config_append              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] log_dir                        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] log_file                       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] log_options                    = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] log_rotate_interval            = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] log_rotate_interval_type       = days {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] log_rotation_type              = none {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] long_rpc_timeout               = 1800 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] max_concurrent_builds          = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] max_concurrent_live_migrations = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] max_concurrent_snapshots       = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] max_local_block_devices        = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] max_logfile_count              = 30 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] max_logfile_size_mb            = 200 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] maximum_instance_delete_attempts = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] metadata_listen                = 0.0.0.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] metadata_listen_port           = 8775 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] metadata_workers               = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] migrate_max_retries            = -1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] mkisofs_cmd                    = genisoimage {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] my_ip                          = 10.0.0.210 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] network_allocate_retries       = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] osapi_compute_listen_port      = 8774 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] osapi_compute_unique_server_name_scope =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] osapi_compute_workers          = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] password_length                = 12 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] periodic_enable                = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] periodic_fuzzy_delay           = 60 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] pointer_model                  = ps2mouse {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] preallocate_images             = none {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] publish_errors                 = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] pybasedir                      = /opt/stack/nova {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ram_allocation_ratio           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] rate_limit_burst               = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] rate_limit_except_level        = CRITICAL {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] rate_limit_interval            = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] reboot_timeout                 = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] reclaim_instance_interval      = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] record                         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] reimage_timeout_per_gb         = 60 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] report_interval                = 120 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] rescue_timeout                 = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] reserved_host_cpus             = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] reserved_host_disk_mb          = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] reserved_host_memory_mb        = 512 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] reserved_huge_pages            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] resize_confirm_window          = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] resize_fs_using_block_device   = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] resume_guests_state_on_host_boot = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] rpc_response_timeout           = 60 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] run_external_periodic_tasks    = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] running_deleted_instance_action = reap {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] running_deleted_instance_timeout = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] scheduler_instance_sync_interval = 120 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] service_down_time              = 720 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] servicegroup_driver            = db {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] shelved_offload_time           = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] shelved_poll_interval          = 3600 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] shutdown_timeout               = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] source_is_ipv6                 = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ssl_only                       = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] state_path                     = /opt/stack/data/nova {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] sync_power_state_interval      = 600 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] sync_power_state_pool_size     = 1000 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] syslog_log_facility            = LOG_USER {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] tempdir                        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] timeout_nbd                    = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] transport_url                  = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] update_resources_interval      = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] use_cow_images                 = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] use_eventlog                   = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] use_journal                    = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] use_json                       = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] use_rootwrap_daemon            = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] use_stderr                     = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] use_syslog                     = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vcpu_pin_set                   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plugging_is_fatal          = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plugging_timeout           = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] virt_mkfs                      = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] volume_usage_poll_interval     = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] watch_log_file                 = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] web                            = /usr/share/spice-html5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_concurrency.disable_process_locking = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.auth_strategy              = keystone {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.compute_link_prefix        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.dhcp_domain                = novalocal {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.enable_instance_password   = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.glance_link_prefix         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.instance_list_per_project_cells = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.list_records_by_skipping_down_cells = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.local_metadata_per_cell    = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.max_limit                  = 1000 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.metadata_cache_expiration  = 15 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.neutron_default_tenant_id  = default {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.use_forwarded_for          = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.use_neutron_default_nets   = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.vendordata_dynamic_targets = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.vendordata_jsonfile_path   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.backend_argument         = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.config_prefix            = cache.oslo {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.dead_timeout             = 60.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.debug_cache_backend      = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.enable_retry_client      = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.enable_socket_keepalive  = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.enabled                  = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.expiration_time          = 600 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.hashclient_retry_attempts = 2 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.memcache_dead_retry      = 300 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.memcache_password        =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.memcache_sasl_enabled    = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.memcache_username        =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.proxies                  = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.retry_attempts           = 2 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.retry_delay              = 0.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.socket_keepalive_count   = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.socket_keepalive_idle    = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.socket_keepalive_interval = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.tls_allowed_ciphers      = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.tls_cafile               = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.tls_certfile             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.tls_enabled              = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cache.tls_keyfile              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.auth_section            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.auth_type               = password {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.cafile                  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.certfile                = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.collect_timing          = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.cross_az_attach         = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.debug                   = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.endpoint_template       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.http_retries            = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.insecure                = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.keyfile                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.os_region_name          = RegionOne {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.split_loggers           = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cinder.timeout                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.cpu_dedicated_set      = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.cpu_shared_set         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.image_type_exclude_list = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.resource_provider_association_refresh = 300 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.shutdown_retry_interval = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] conductor.workers              = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] console.allowed_origins        = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] console.ssl_ciphers            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] console.ssl_minimum_version    = default {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] consoleauth.token_ttl          = 600 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.cafile                  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.certfile                = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.collect_timing          = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.connect_retries         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.connect_retry_delay     = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.endpoint_override       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.insecure                = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.keyfile                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.max_version             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.min_version             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.region_name             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.service_name            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.service_type            = accelerator {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.split_loggers           = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.status_code_retries     = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.status_code_retry_delay = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.timeout                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] cyborg.version                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.backend               = sqlalchemy {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.connection            = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.connection_debug      = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.connection_parameters =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.connection_recycle_time = 3600 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.connection_trace      = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.db_inc_retry_interval = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.db_max_retries        = 20 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.db_max_retry_interval = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.db_retry_interval     = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.max_overflow          = 50 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.max_pool_size         = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.max_retries           = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.mysql_wsrep_sync_wait = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.pool_timeout          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.retry_interval        = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.slave_connection      = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] database.sqlite_synchronous    = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.backend           = sqlalchemy {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.connection        = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.connection_debug  = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.connection_parameters =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.connection_recycle_time = 3600 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.connection_trace  = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.db_inc_retry_interval = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.db_max_retries    = 20 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.db_max_retry_interval = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.db_retry_interval = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.max_overflow      = 50 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.max_pool_size     = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.max_retries       = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.pool_timeout      = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.retry_interval    = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.slave_connection  = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] api_database.sqlite_synchronous = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] devices.enabled_mdev_types     = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ephemeral_storage_encryption.enabled = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.api_servers             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.cafile                  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.certfile                = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.collect_timing          = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.connect_retries         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.connect_retry_delay     = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.debug                   = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.default_trusted_certificate_ids = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.enable_certificate_validation = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.enable_rbd_download     = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.endpoint_override       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.insecure                = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.keyfile                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.max_version             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.min_version             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.num_retries             = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.rbd_ceph_conf           =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.rbd_connect_timeout     = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.rbd_pool                =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.rbd_user                =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.region_name             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.service_name            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.service_type            = image {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.split_loggers           = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.status_code_retries     = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.status_code_retry_delay = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.timeout                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.verify_glance_signatures = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] glance.version                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] guestfs.debug                  = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.config_drive_cdrom      = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.config_drive_inject_password = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.enable_remotefx         = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.instances_path_share    =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.limit_cpu_features      = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.use_multipath_io        = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.vswitch_name            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] mks.enabled                    = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] image_cache.manager_interval   = 2400 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] image_cache.precache_concurrency = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] image_cache.remove_unused_base_images = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] image_cache.subdirectory_name  = _base {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.api_max_retries         = 60 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.api_retry_interval      = 2 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.auth_section            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.auth_type               = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.cafile                  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.certfile                = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.collect_timing          = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.conductor_group         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.connect_retries         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.connect_retry_delay     = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.endpoint_override       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.insecure                = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.keyfile                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.max_version             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.min_version             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.peer_list               = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.region_name             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.serial_console_state_timeout = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.service_name            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.service_type            = baremetal {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.split_loggers           = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.status_code_retries     = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.status_code_retry_delay = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.timeout                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ironic.version                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] key_manager.fixed_key          = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.barbican_api_version  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.barbican_endpoint     = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.barbican_endpoint_type = public {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.barbican_region_name  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.cafile                = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.certfile              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.collect_timing        = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.insecure              = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.keyfile               = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.number_of_retries     = 60 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.retry_delay           = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.send_service_user_token = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.split_loggers         = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.timeout               = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.verify_ssl            = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican.verify_ssl_path       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican_service_user.auth_section = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican_service_user.auth_type = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican_service_user.cafile   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican_service_user.certfile = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican_service_user.collect_timing = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican_service_user.insecure = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican_service_user.keyfile  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican_service_user.split_loggers = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] barbican_service_user.timeout  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.approle_role_id          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.approle_secret_id        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.cafile                   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.certfile                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.collect_timing           = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.insecure                 = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.keyfile                  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.kv_mountpoint            = secret {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.kv_path                  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.kv_version               = 2 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.namespace                = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.root_token_id            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.split_loggers            = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.ssl_ca_crt_file          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.timeout                  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.use_ssl                  = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.auth_section          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.auth_type             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.cafile                = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.certfile              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.collect_timing        = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.connect_retries       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.connect_retry_delay   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.endpoint_override     = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.insecure              = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.keyfile               = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.max_version           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.min_version           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.region_name           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.service_name          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.service_type          = identity {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.split_loggers         = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.status_code_retries   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.status_code_retry_delay = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.timeout               = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] keystone.version               = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.connection_uri         =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.cpu_mode               = custom {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: WARNING oslo_config.cfg [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.cpu_power_governor_high = performance {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.cpu_power_management   = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.device_detach_attempts = 8 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.device_detach_timeout  = 20 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.disk_cachemodes        = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.disk_prefix            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.enabled_perf_events    = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.file_backed_memory     = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.gid_maps               = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.hw_disk_discard        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.hw_machine_type        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.images_rbd_pool        = rbd {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.images_type            = default {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.images_volume_group    = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.inject_key             = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.inject_partition       = -2 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.inject_password        = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.iscsi_iface            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.iser_use_multipath     = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_downtime = 500 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_inbound_addr = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_scheme  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_timeout_action = abort {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_tunnelled = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: WARNING oslo_config.cfg [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 16 15:12:50 user nova-compute[74658]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 16 15:12:50 user nova-compute[74658]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 16 15:12:50 user nova-compute[74658]: and ``live_migration_inbound_addr`` respectively.
Nov 16 15:12:50 user nova-compute[74658]: ).  Its value may be silently ignored in the future.
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.live_migration_with_native_tls = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.max_queues             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.nfs_mount_options      = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.num_pcie_ports         = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.pmem_namespaces        = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.quobyte_client_cfg     = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.rbd_secret_uuid        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.rbd_user               = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.rescue_image_id        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.rescue_kernel_id       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.rx_queue_size          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.smbfs_mount_options    =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.snapshot_compression   = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.snapshot_image_format  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.sparse_logical_volumes = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.swtpm_enabled          = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.swtpm_group            = tss {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.swtpm_user             = tss {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.sysinfo_serial         = unique {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.tb_cache_size          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.tx_queue_size          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.uid_maps               = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.use_virtio_for_bridges = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.virt_type              = kvm {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.volume_clear           = zero {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.volume_clear_size      = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.volume_use_multipath   = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.vzstorage_cache_path   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.auth_section           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.auth_type              = password {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.cafile                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.certfile               = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.collect_timing         = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.connect_retries        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.connect_retry_delay    = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.default_floating_pool  = public {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.endpoint_override      = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.extension_sync_interval = 600 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.http_retries           = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.insecure               = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.keyfile                = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.max_version            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.min_version            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.ovs_bridge             = br-int {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.physnets               = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.region_name            = RegionOne {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.service_metadata_proxy = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.service_name           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.service_type           = network {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.split_loggers          = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.status_code_retries    = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.status_code_retry_delay = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.timeout                = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] neutron.version                = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] notifications.bdms_in_notifications = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] notifications.default_level    = INFO {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] notifications.notification_format = unversioned {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] notifications.notify_on_state_change = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] pci.alias                      = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] pci.device_spec                = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] pci.report_in_placement        = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.auth_section         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.auth_type            = password {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.cafile               = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.certfile             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.collect_timing       = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.connect_retries      = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.connect_retry_delay  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.default_domain_id    = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.default_domain_name  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.domain_id            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.domain_name          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.endpoint_override    = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.insecure             = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.keyfile              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.max_version          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.min_version          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.password             = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.project_domain_id    = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.project_domain_name  = Default {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.project_id           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.project_name         = service {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.region_name          = RegionOne {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.service_name         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.service_type         = placement {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.split_loggers        = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.status_code_retries  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.status_code_retry_delay = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.system_scope         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.timeout              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.trust_id             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.user_domain_id       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.user_domain_name     = Default {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.user_id              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.username             = placement {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] placement.version              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.cores                    = 20 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.count_usage_from_placement = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.injected_file_content_bytes = 10240 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.injected_file_path_length = 255 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.injected_files           = 5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.instances                = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.key_pairs                = 100 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.metadata_items           = 128 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.ram                      = 51200 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.recheck_quota            = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.server_group_members     = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] quota.server_groups            = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] rdp.enabled                    = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] scheduler.image_metadata_prefilter = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] scheduler.max_attempts         = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] scheduler.max_placement_results = 1000 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] scheduler.workers              = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.host_subset_size = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.isolated_hosts = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.isolated_images = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.pci_in_placement = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.track_instance_changes = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] metrics.required               = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] metrics.weight_multiplier      = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] metrics.weight_setting         = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] serial_console.enabled         = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] serial_console.port_range      = 10000:20000 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] serial_console.serialproxy_port = 6083 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] service_user.auth_section      = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] service_user.auth_type         = password {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] service_user.cafile            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] service_user.certfile          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] service_user.collect_timing    = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] service_user.insecure          = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] service_user.keyfile           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] service_user.send_service_user_token = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] service_user.split_loggers     = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] service_user.timeout           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.agent_enabled            = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.enabled                  = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.html5proxy_port          = 6082 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.image_compression        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.jpeg_compression         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.playback_compression     = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.server_listen            = 127.0.0.1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.streaming_mode           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] spice.zlib_compression         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] upgrade_levels.baseapi         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] upgrade_levels.cert            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] upgrade_levels.compute         = auto {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] upgrade_levels.conductor       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] upgrade_levels.scheduler       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vendordata_dynamic_auth.cafile = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vendordata_dynamic_auth.certfile = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vendordata_dynamic_auth.insecure = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vendordata_dynamic_auth.timeout = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.api_retry_count         = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.ca_file                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.cache_prefix            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.cluster_name            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.connection_pool_size    = 10 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.console_delay_seconds   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.datastore_regex         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.host_ip                 = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.host_password           = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.host_port               = 443 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.host_username           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.insecure                = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.integration_bridge      = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.maximum_objects         = 100 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.pbm_default_policy      = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.pbm_enabled             = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.pbm_wsdl_location       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.serial_port_proxy_uri   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.serial_port_service_uri = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.task_poll_interval      = 0.5 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.use_linked_clone        = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.vnc_keymap              = en-us {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.vnc_port                = 5900 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vmware.vnc_port_total          = 10000 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vnc.auth_schemes               = ['none'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vnc.enabled                    = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vnc.novncproxy_port            = 6080 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vnc.vencrypt_ca_certs          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vnc.vencrypt_client_cert       = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vnc.vencrypt_client_key        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.disable_rootwrap   = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.enable_numa_live_migration = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.libvirt_disable_apic = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] wsgi.client_socket_timeout     = 900 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] wsgi.default_pool_size         = 1000 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] wsgi.keep_alive                = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] wsgi.max_header_line           = 16384 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] wsgi.ssl_ca_file               = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] wsgi.ssl_cert_file             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] wsgi.ssl_key_file              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] wsgi.tcp_keepidle              = 600 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] zvm.ca_file                    = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] zvm.cloud_connector_url        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] zvm.reachable_timeout          = 300 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_policy.enforce_new_defaults = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_policy.enforce_scope      = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_policy.policy_default_rule = default {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler.connection_string     = messaging:// {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler.enabled               = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler.es_doc_type           = notification {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler.es_scroll_size        = 10000 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler.es_scroll_time        = 2m {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler.filter_error_trace    = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler.hmac_keys             = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler.sentinel_service_name = mymaster {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler.socket_timeout        = 0.1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler.trace_requests        = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler.trace_sqlalchemy      = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler_jaeger.process_tags   = {} {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler_jaeger.service_name_prefix = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] profiler_otlp.service_name_prefix = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] remote_debug.host              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] remote_debug.port              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_notifications.retry = -1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.auth_section        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.auth_type           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.cafile              = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.certfile            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.collect_timing      = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.connect_retries     = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.connect_retry_delay = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.endpoint_id         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.endpoint_override   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.insecure            = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.keyfile             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.max_version         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.min_version         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.region_name         = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.service_name        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.service_type        = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.split_loggers       = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.status_code_retries = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.status_code_retry_delay = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.timeout             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.valid_interfaces    = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_limit.version             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_reports.file_event_handler = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] oslo_reports.log_dir           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_ovs_privileged.group  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] vif_plug_ovs_privileged.user   = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_ovs.isolate_vif         = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] os_brick.lock_path             = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] privsep_osbrick.capabilities   = [21] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] privsep_osbrick.group          = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] privsep_osbrick.helper_command = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] privsep_osbrick.user           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] nova_sys_admin.group           = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] nova_sys_admin.helper_command  = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] nova_sys_admin.user            = None {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG oslo_service.service [None req-3fc1031a-903e-4171-807e-9c03dea311d1 None None] ******************************************************************************** {{(pid=74658) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 16 15:12:50 user nova-compute[74658]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 16 15:12:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Connecting to libvirt: qemu:///system {{(pid=74658) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f0733f323b0> {{(pid=74658) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 16 15:12:50 user nova-compute[74658]: libvirt:  error : internal error: could not initialize domain event timer
Nov 16 15:12:50 user nova-compute[74658]: WARNING nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 16 15:12:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f0733f323b0> {{(pid=74658) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Starting native event thread {{(pid=74658) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Starting green dispatch thread {{(pid=74658) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 16 15:12:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Starting connection event dispatch thread {{(pid=74658) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 16 15:12:50 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Connection event '1' reason 'None'
Nov 16 15:12:50 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 15:12:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.mount [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Initialising _HostMountState generation 0 {{(pid=74658) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 16 15:12:58 user nova-compute[74658]: INFO nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Libvirt host capabilities <capabilities>
Nov 16 15:12:58 user nova-compute[74658]:   <host>
Nov 16 15:12:58 user nova-compute[74658]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 16 15:12:58 user nova-compute[74658]:     <cpu>
Nov 16 15:12:58 user nova-compute[74658]:       <arch>x86_64</arch>
Nov 16 15:12:58 user nova-compute[74658]:       <model>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <vendor>Intel</vendor>
Nov 16 15:12:58 user nova-compute[74658]:       <microcode version='1070'/>
Nov 16 15:12:58 user nova-compute[74658]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 16 15:12:58 user nova-compute[74658]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='ss'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='vmx'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='pcid'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='osxsave'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='hypervisor'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='arat'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='tsc_adjust'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='md-clear'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='arch-capabilities'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='invtsc'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='rsba'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature name='skip-l1dfl-vmentry'/>
Nov 16 15:12:58 user nova-compute[74658]:       <pages unit='KiB' size='4'/>
Nov 16 15:12:58 user nova-compute[74658]:       <pages unit='KiB' size='2048'/>
Nov 16 15:12:58 user nova-compute[74658]:     </cpu>
Nov 16 15:12:58 user nova-compute[74658]:     <power_management>
Nov 16 15:12:58 user nova-compute[74658]:       <suspend_mem/>
Nov 16 15:12:58 user nova-compute[74658]:       <suspend_disk/>
Nov 16 15:12:58 user nova-compute[74658]:       <suspend_hybrid/>
Nov 16 15:12:58 user nova-compute[74658]:     </power_management>
Nov 16 15:12:58 user nova-compute[74658]:     <iommu support='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     <migration_features>
Nov 16 15:12:58 user nova-compute[74658]:       <live/>
Nov 16 15:12:58 user nova-compute[74658]:       <uri_transports>
Nov 16 15:12:58 user nova-compute[74658]:         <uri_transport>tcp</uri_transport>
Nov 16 15:12:58 user nova-compute[74658]:         <uri_transport>rdma</uri_transport>
Nov 16 15:12:58 user nova-compute[74658]:       </uri_transports>
Nov 16 15:12:58 user nova-compute[74658]:     </migration_features>
Nov 16 15:12:58 user nova-compute[74658]:     <topology>
Nov 16 15:12:58 user nova-compute[74658]:       <cells num='2'>
Nov 16 15:12:58 user nova-compute[74658]:         <cell id='0'>
Nov 16 15:12:58 user nova-compute[74658]:           <memory unit='KiB'>8189224</memory>
Nov 16 15:12:58 user nova-compute[74658]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 16 15:12:58 user nova-compute[74658]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 15:12:58 user nova-compute[74658]:           <distances>
Nov 16 15:12:58 user nova-compute[74658]:             <sibling id='0' value='10'/>
Nov 16 15:12:58 user nova-compute[74658]:             <sibling id='1' value='20'/>
Nov 16 15:12:58 user nova-compute[74658]:           </distances>
Nov 16 15:12:58 user nova-compute[74658]:           <cpus num='6'>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 16 15:12:58 user nova-compute[74658]:           </cpus>
Nov 16 15:12:58 user nova-compute[74658]:         </cell>
Nov 16 15:12:58 user nova-compute[74658]:         <cell id='1'>
Nov 16 15:12:58 user nova-compute[74658]:           <memory unit='KiB'>8206460</memory>
Nov 16 15:12:58 user nova-compute[74658]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 16 15:12:58 user nova-compute[74658]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 15:12:58 user nova-compute[74658]:           <distances>
Nov 16 15:12:58 user nova-compute[74658]:             <sibling id='0' value='20'/>
Nov 16 15:12:58 user nova-compute[74658]:             <sibling id='1' value='10'/>
Nov 16 15:12:58 user nova-compute[74658]:           </distances>
Nov 16 15:12:58 user nova-compute[74658]:           <cpus num='6'>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 16 15:12:58 user nova-compute[74658]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 16 15:12:58 user nova-compute[74658]:           </cpus>
Nov 16 15:12:58 user nova-compute[74658]:         </cell>
Nov 16 15:12:58 user nova-compute[74658]:       </cells>
Nov 16 15:12:58 user nova-compute[74658]:     </topology>
Nov 16 15:12:58 user nova-compute[74658]:     <cache>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 16 15:12:58 user nova-compute[74658]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 16 15:12:58 user nova-compute[74658]:     </cache>
Nov 16 15:12:58 user nova-compute[74658]:     <secmodel>
Nov 16 15:12:58 user nova-compute[74658]:       <model>apparmor</model>
Nov 16 15:12:58 user nova-compute[74658]:       <doi>0</doi>
Nov 16 15:12:58 user nova-compute[74658]:     </secmodel>
Nov 16 15:12:58 user nova-compute[74658]:     <secmodel>
Nov 16 15:12:58 user nova-compute[74658]:       <model>dac</model>
Nov 16 15:12:58 user nova-compute[74658]:       <doi>0</doi>
Nov 16 15:12:58 user nova-compute[74658]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 16 15:12:58 user nova-compute[74658]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 16 15:12:58 user nova-compute[74658]:     </secmodel>
Nov 16 15:12:58 user nova-compute[74658]:   </host>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='alpha'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>64</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>clipper</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='armv6l'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>spitz</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>nuri</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>kzm</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sx1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>z2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>tosa</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>n810</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>n800</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>terrier</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>midway</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>microbit</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>verdex</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>highbank</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>akita</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>connex</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>collie</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='armv7l'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>spitz</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>nuri</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>kzm</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sx1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>z2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>tosa</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>n810</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>n800</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>terrier</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>midway</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>microbit</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>verdex</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>highbank</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>akita</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>connex</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>collie</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='aarch64'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>64</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>spitz</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>nuri</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>kzm</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sx1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>z2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>tosa</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>n810</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>n800</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>terrier</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>midway</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>microbit</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>verdex</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>raspi3b</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>highbank</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>akita</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>connex</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>collie</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <acpi default='on' toggle='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='cris'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='i686'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>isapc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>microvm</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='kvm'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <pae/>
Nov 16 15:12:58 user nova-compute[74658]:       <nonpae/>
Nov 16 15:12:58 user nova-compute[74658]:       <acpi default='on' toggle='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:       <apic default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='m68k'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>an5206</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>q800</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>next-cube</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='microblaze'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='microblazeel'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='mips'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='16'>malta</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='mipsel'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='16'>malta</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='mips64'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>64</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='16'>malta</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>pica61</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>magnum</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='mips64el'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>64</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='16'>malta</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>pica61</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>magnum</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='16'>boston</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='ppc'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mac99</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>40p</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>taihu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='ppc64'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>64</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>taihu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>40p</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mac99</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='ppc64le'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>64</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>taihu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>40p</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>mac99</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='riscv32'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='8'>spike</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>opentitan</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='8'>virt</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='riscv64'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>64</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='8'>spike</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>shakti_c</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='8'>virt</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='s390x'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>64</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='sh4'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>shix</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>r2d</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='sh4eb'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>64</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>shix</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>r2d</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='sparc'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>SS-5</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>SS-20</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>LX</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>SS-4</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>SS-10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>Voyager</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='sparc64'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>64</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sun4u</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>niagara</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>sun4v</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='x86_64'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>64</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='1'>isapc</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>microvm</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='kvm'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <acpi default='on' toggle='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:       <apic default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='xtensa'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>sim</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>kc705</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>ml605</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>virt</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>lx200</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>lx60</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]:   <guest>
Nov 16 15:12:58 user nova-compute[74658]:     <os_type>hvm</os_type>
Nov 16 15:12:58 user nova-compute[74658]:     <arch name='xtensaeb'>
Nov 16 15:12:58 user nova-compute[74658]:       <wordsize>32</wordsize>
Nov 16 15:12:58 user nova-compute[74658]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='4'>sim</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>kc705</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>ml605</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>virt</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>lx200</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>lx60</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 15:12:58 user nova-compute[74658]:       <domain type='qemu'/>
Nov 16 15:12:58 user nova-compute[74658]:     </arch>
Nov 16 15:12:58 user nova-compute[74658]:     <features>
Nov 16 15:12:58 user nova-compute[74658]:       <cpuselection/>
Nov 16 15:12:58 user nova-compute[74658]:       <deviceboot/>
Nov 16 15:12:58 user nova-compute[74658]:       <disksnapshot default='on' toggle='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     </features>
Nov 16 15:12:58 user nova-compute[74658]:   </guest>
Nov 16 15:12:58 user nova-compute[74658]: </capabilities>
Nov 16 15:12:58 user nova-compute[74658]: 
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 16 15:12:58 user nova-compute[74658]: <domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 15:12:58 user nova-compute[74658]:   <domain>kvm</domain>
Nov 16 15:12:58 user nova-compute[74658]:   <machine>pc-i440fx-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:   <arch>i686</arch>
Nov 16 15:12:58 user nova-compute[74658]:   <vcpu max='255'/>
Nov 16 15:12:58 user nova-compute[74658]:   <iothreads supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:   <os supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='firmware'/>
Nov 16 15:12:58 user nova-compute[74658]:     <loader supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>rom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pflash</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='readonly'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>yes</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='secure'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </loader>
Nov 16 15:12:58 user nova-compute[74658]:   </os>
Nov 16 15:12:58 user nova-compute[74658]:   <cpu>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-passthrough' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='hostPassthroughMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='maximum' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='maximumMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-model' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <vendor>Intel</vendor>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ss'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='vmx'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pcid'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='hypervisor'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arat'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='umip'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='md-clear'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibpb'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibrs'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='erms'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='lm'/>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='custom' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>qemu64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>qemu32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>phenom</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>n270</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>kvm64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>coreduo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>core2duo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>athlon</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Westmere</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Snowridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Penryn</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G5</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G4</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G1</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Nehalem</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Rome</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Milan</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Dhyana</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cooperlake</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Conroe</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>486</model>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:   </cpu>
Nov 16 15:12:58 user nova-compute[74658]:   <memoryBacking supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='sourceType'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>file</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>anonymous</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>memfd</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:   </memoryBacking>
Nov 16 15:12:58 user nova-compute[74658]:   <devices>
Nov 16 15:12:58 user nova-compute[74658]:     <disk supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='diskDevice'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>disk</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cdrom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>floppy</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>lun</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='bus'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ide</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>fdc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sata</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </disk>
Nov 16 15:12:58 user nova-compute[74658]:     <graphics supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sdl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vnc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>spice</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egl-headless</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </graphics>
Nov 16 15:12:58 user nova-compute[74658]:     <video supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='modelType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cirrus</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vmvga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>qxl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>none</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>bochs</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ramfb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </video>
Nov 16 15:12:58 user nova-compute[74658]:     <hostdev supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='mode'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>subsystem</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='startupPolicy'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>default</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>mandatory</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>requisite</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>optional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='subsysType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pci</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='capsType'/>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='pciBackend'/>
Nov 16 15:12:58 user nova-compute[74658]:     </hostdev>
Nov 16 15:12:58 user nova-compute[74658]:     <rng supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>random</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egd</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>builtin</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </rng>
Nov 16 15:12:58 user nova-compute[74658]:     <filesystem supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='driverType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>path</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>handle</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtiofs</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </filesystem>
Nov 16 15:12:58 user nova-compute[74658]:     <tpm supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-tis</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-crb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>passthrough</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>emulator</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </tpm>
Nov 16 15:12:58 user nova-compute[74658]:   </devices>
Nov 16 15:12:58 user nova-compute[74658]:   <features>
Nov 16 15:12:58 user nova-compute[74658]:     <gic supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     <vmcoreinfo supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <genid supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backingStoreInput supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backup supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <sev supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:   </features>
Nov 16 15:12:58 user nova-compute[74658]: </domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:  {{(pid=74658) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 16 15:12:58 user nova-compute[74658]: <domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 15:12:58 user nova-compute[74658]:   <domain>kvm</domain>
Nov 16 15:12:58 user nova-compute[74658]:   <machine>pc-q35-jammy</machine>
Nov 16 15:12:58 user nova-compute[74658]:   <arch>i686</arch>
Nov 16 15:12:58 user nova-compute[74658]:   <vcpu max='288'/>
Nov 16 15:12:58 user nova-compute[74658]:   <iothreads supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:   <os supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='firmware'/>
Nov 16 15:12:58 user nova-compute[74658]:     <loader supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>rom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pflash</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='readonly'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>yes</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='secure'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </loader>
Nov 16 15:12:58 user nova-compute[74658]:   </os>
Nov 16 15:12:58 user nova-compute[74658]:   <cpu>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-passthrough' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='hostPassthroughMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='maximum' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='maximumMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-model' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <vendor>Intel</vendor>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ss'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='vmx'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pcid'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='hypervisor'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arat'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='umip'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='md-clear'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibpb'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibrs'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='erms'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='lm'/>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='custom' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>qemu64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>qemu32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>phenom</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>n270</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>kvm64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>coreduo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>core2duo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>athlon</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Westmere</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Snowridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Penryn</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G5</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G4</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G1</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Nehalem</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Rome</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Milan</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Dhyana</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cooperlake</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Conroe</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>486</model>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:   </cpu>
Nov 16 15:12:58 user nova-compute[74658]:   <memoryBacking supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='sourceType'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>file</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>anonymous</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>memfd</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:   </memoryBacking>
Nov 16 15:12:58 user nova-compute[74658]:   <devices>
Nov 16 15:12:58 user nova-compute[74658]:     <disk supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='diskDevice'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>disk</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cdrom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>floppy</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>lun</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='bus'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>fdc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sata</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </disk>
Nov 16 15:12:58 user nova-compute[74658]:     <graphics supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sdl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vnc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>spice</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egl-headless</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </graphics>
Nov 16 15:12:58 user nova-compute[74658]:     <video supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='modelType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cirrus</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vmvga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>qxl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>none</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>bochs</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ramfb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </video>
Nov 16 15:12:58 user nova-compute[74658]:     <hostdev supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='mode'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>subsystem</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='startupPolicy'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>default</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>mandatory</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>requisite</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>optional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='subsysType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pci</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='capsType'/>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='pciBackend'/>
Nov 16 15:12:58 user nova-compute[74658]:     </hostdev>
Nov 16 15:12:58 user nova-compute[74658]:     <rng supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>random</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egd</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>builtin</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </rng>
Nov 16 15:12:58 user nova-compute[74658]:     <filesystem supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='driverType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>path</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>handle</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtiofs</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </filesystem>
Nov 16 15:12:58 user nova-compute[74658]:     <tpm supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-tis</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-crb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>passthrough</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>emulator</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </tpm>
Nov 16 15:12:58 user nova-compute[74658]:   </devices>
Nov 16 15:12:58 user nova-compute[74658]:   <features>
Nov 16 15:12:58 user nova-compute[74658]:     <gic supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     <vmcoreinfo supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <genid supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backingStoreInput supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backup supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <sev supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:   </features>
Nov 16 15:12:58 user nova-compute[74658]: </domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:  {{(pid=74658) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 16 15:12:58 user nova-compute[74658]: <domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 15:12:58 user nova-compute[74658]:   <domain>kvm</domain>
Nov 16 15:12:58 user nova-compute[74658]:   <machine>pc-q35-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:   <arch>i686</arch>
Nov 16 15:12:58 user nova-compute[74658]:   <vcpu max='288'/>
Nov 16 15:12:58 user nova-compute[74658]:   <iothreads supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:   <os supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='firmware'/>
Nov 16 15:12:58 user nova-compute[74658]:     <loader supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>rom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pflash</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='readonly'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>yes</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='secure'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </loader>
Nov 16 15:12:58 user nova-compute[74658]:   </os>
Nov 16 15:12:58 user nova-compute[74658]:   <cpu>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-passthrough' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='hostPassthroughMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='maximum' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='maximumMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-model' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <vendor>Intel</vendor>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ss'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='vmx'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pcid'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='hypervisor'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arat'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='umip'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='md-clear'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibpb'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibrs'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='erms'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='lm'/>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='custom' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>qemu64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>qemu32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>phenom</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>n270</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>kvm64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>coreduo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>core2duo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>athlon</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Westmere</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Snowridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Penryn</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G5</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G4</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G1</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Nehalem</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Rome</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Milan</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Dhyana</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cooperlake</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Conroe</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>486</model>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:   </cpu>
Nov 16 15:12:58 user nova-compute[74658]:   <memoryBacking supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='sourceType'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>file</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>anonymous</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>memfd</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:   </memoryBacking>
Nov 16 15:12:58 user nova-compute[74658]:   <devices>
Nov 16 15:12:58 user nova-compute[74658]:     <disk supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='diskDevice'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>disk</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cdrom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>floppy</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>lun</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='bus'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>fdc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sata</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </disk>
Nov 16 15:12:58 user nova-compute[74658]:     <graphics supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sdl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vnc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>spice</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egl-headless</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </graphics>
Nov 16 15:12:58 user nova-compute[74658]:     <video supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='modelType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cirrus</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vmvga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>qxl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>none</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>bochs</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ramfb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </video>
Nov 16 15:12:58 user nova-compute[74658]:     <hostdev supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='mode'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>subsystem</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='startupPolicy'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>default</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>mandatory</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>requisite</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>optional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='subsysType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pci</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='capsType'/>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='pciBackend'/>
Nov 16 15:12:58 user nova-compute[74658]:     </hostdev>
Nov 16 15:12:58 user nova-compute[74658]:     <rng supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>random</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egd</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>builtin</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </rng>
Nov 16 15:12:58 user nova-compute[74658]:     <filesystem supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='driverType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>path</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>handle</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtiofs</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </filesystem>
Nov 16 15:12:58 user nova-compute[74658]:     <tpm supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-tis</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-crb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>passthrough</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>emulator</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </tpm>
Nov 16 15:12:58 user nova-compute[74658]:   </devices>
Nov 16 15:12:58 user nova-compute[74658]:   <features>
Nov 16 15:12:58 user nova-compute[74658]:     <gic supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     <vmcoreinfo supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <genid supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backingStoreInput supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backup supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <sev supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:   </features>
Nov 16 15:12:58 user nova-compute[74658]: </domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:  {{(pid=74658) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 16 15:12:58 user nova-compute[74658]: <domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 15:12:58 user nova-compute[74658]:   <domain>kvm</domain>
Nov 16 15:12:58 user nova-compute[74658]:   <machine>pc-i440fx-jammy</machine>
Nov 16 15:12:58 user nova-compute[74658]:   <arch>i686</arch>
Nov 16 15:12:58 user nova-compute[74658]:   <vcpu max='255'/>
Nov 16 15:12:58 user nova-compute[74658]:   <iothreads supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:   <os supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='firmware'/>
Nov 16 15:12:58 user nova-compute[74658]:     <loader supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>rom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pflash</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='readonly'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>yes</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='secure'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </loader>
Nov 16 15:12:58 user nova-compute[74658]:   </os>
Nov 16 15:12:58 user nova-compute[74658]:   <cpu>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-passthrough' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='hostPassthroughMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='maximum' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='maximumMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-model' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <vendor>Intel</vendor>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ss'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='vmx'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pcid'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='hypervisor'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arat'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='umip'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='md-clear'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibpb'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibrs'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='erms'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='lm'/>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='custom' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>qemu64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>qemu32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>phenom</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>n270</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>kvm64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>coreduo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>core2duo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>athlon</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Westmere</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Snowridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Penryn</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G5</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G4</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G1</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Nehalem</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Rome</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Milan</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Dhyana</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cooperlake</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Conroe</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>486</model>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:   </cpu>
Nov 16 15:12:58 user nova-compute[74658]:   <memoryBacking supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='sourceType'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>file</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>anonymous</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>memfd</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:   </memoryBacking>
Nov 16 15:12:58 user nova-compute[74658]:   <devices>
Nov 16 15:12:58 user nova-compute[74658]:     <disk supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='diskDevice'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>disk</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cdrom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>floppy</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>lun</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='bus'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ide</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>fdc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sata</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </disk>
Nov 16 15:12:58 user nova-compute[74658]:     <graphics supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sdl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vnc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>spice</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egl-headless</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </graphics>
Nov 16 15:12:58 user nova-compute[74658]:     <video supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='modelType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cirrus</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vmvga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>qxl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>none</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>bochs</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ramfb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </video>
Nov 16 15:12:58 user nova-compute[74658]:     <hostdev supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='mode'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>subsystem</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='startupPolicy'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>default</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>mandatory</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>requisite</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>optional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='subsysType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pci</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='capsType'/>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='pciBackend'/>
Nov 16 15:12:58 user nova-compute[74658]:     </hostdev>
Nov 16 15:12:58 user nova-compute[74658]:     <rng supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>random</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egd</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>builtin</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </rng>
Nov 16 15:12:58 user nova-compute[74658]:     <filesystem supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='driverType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>path</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>handle</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtiofs</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </filesystem>
Nov 16 15:12:58 user nova-compute[74658]:     <tpm supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-tis</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-crb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>passthrough</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>emulator</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </tpm>
Nov 16 15:12:58 user nova-compute[74658]:   </devices>
Nov 16 15:12:58 user nova-compute[74658]:   <features>
Nov 16 15:12:58 user nova-compute[74658]:     <gic supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     <vmcoreinfo supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <genid supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backingStoreInput supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backup supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <sev supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:   </features>
Nov 16 15:12:58 user nova-compute[74658]: </domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:  {{(pid=74658) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 16 15:12:58 user nova-compute[74658]: <domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 15:12:58 user nova-compute[74658]:   <domain>kvm</domain>
Nov 16 15:12:58 user nova-compute[74658]:   <machine>pc-i440fx-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:   <arch>x86_64</arch>
Nov 16 15:12:58 user nova-compute[74658]:   <vcpu max='255'/>
Nov 16 15:12:58 user nova-compute[74658]:   <iothreads supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:   <os supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='firmware'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>efi</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:     <loader supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>rom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pflash</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='readonly'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>yes</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='secure'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </loader>
Nov 16 15:12:58 user nova-compute[74658]:   </os>
Nov 16 15:12:58 user nova-compute[74658]:   <cpu>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-passthrough' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='hostPassthroughMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='maximum' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='maximumMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-model' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <vendor>Intel</vendor>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ss'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='vmx'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pcid'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='hypervisor'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arat'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='umip'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='md-clear'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='invtsc'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibpb'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibrs'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='rsba'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='erms'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='custom' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>qemu64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>qemu32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>phenom</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>n270</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>coreduo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>core2duo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>athlon</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Westmere</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Snowridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Penryn</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G5</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G4</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Opteron_G1</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Nehalem</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Rome</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Milan</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Dhyana</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cooperlake</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Conroe</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>486</model>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:   </cpu>
Nov 16 15:12:58 user nova-compute[74658]:   <memoryBacking supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='sourceType'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>file</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>anonymous</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>memfd</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:   </memoryBacking>
Nov 16 15:12:58 user nova-compute[74658]:   <devices>
Nov 16 15:12:58 user nova-compute[74658]:     <disk supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='diskDevice'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>disk</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cdrom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>floppy</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>lun</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='bus'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ide</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>fdc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sata</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </disk>
Nov 16 15:12:58 user nova-compute[74658]:     <graphics supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sdl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vnc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>spice</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egl-headless</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </graphics>
Nov 16 15:12:58 user nova-compute[74658]:     <video supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='modelType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cirrus</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vmvga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>qxl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>none</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>bochs</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ramfb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </video>
Nov 16 15:12:58 user nova-compute[74658]:     <hostdev supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='mode'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>subsystem</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='startupPolicy'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>default</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>mandatory</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>requisite</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>optional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='subsysType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pci</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='capsType'/>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='pciBackend'/>
Nov 16 15:12:58 user nova-compute[74658]:     </hostdev>
Nov 16 15:12:58 user nova-compute[74658]:     <rng supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>random</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egd</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>builtin</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </rng>
Nov 16 15:12:58 user nova-compute[74658]:     <filesystem supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='driverType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>path</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>handle</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtiofs</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </filesystem>
Nov 16 15:12:58 user nova-compute[74658]:     <tpm supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-tis</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-crb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>passthrough</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>emulator</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </tpm>
Nov 16 15:12:58 user nova-compute[74658]:   </devices>
Nov 16 15:12:58 user nova-compute[74658]:   <features>
Nov 16 15:12:58 user nova-compute[74658]:     <gic supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     <vmcoreinfo supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <genid supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backingStoreInput supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backup supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <sev supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:   </features>
Nov 16 15:12:58 user nova-compute[74658]: </domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:  {{(pid=74658) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 16 15:12:58 user nova-compute[74658]: <domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 15:12:58 user nova-compute[74658]:   <domain>kvm</domain>
Nov 16 15:12:58 user nova-compute[74658]:   <machine>pc-q35-jammy</machine>
Nov 16 15:12:58 user nova-compute[74658]:   <arch>x86_64</arch>
Nov 16 15:12:58 user nova-compute[74658]:   <vcpu max='288'/>
Nov 16 15:12:58 user nova-compute[74658]:   <iothreads supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:   <os supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='firmware'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>efi</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:     <loader supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>rom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pflash</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='readonly'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>yes</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='secure'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>yes</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </loader>
Nov 16 15:12:58 user nova-compute[74658]:   </os>
Nov 16 15:12:58 user nova-compute[74658]:   <cpu>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-passthrough' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='hostPassthroughMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='maximum' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='maximumMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-model' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <vendor>Intel</vendor>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ss'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='vmx'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pcid'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='hypervisor'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arat'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='umip'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='md-clear'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='invtsc'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibpb'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibrs'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='rsba'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='erms'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='custom' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>qemu64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>qemu32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>phenom</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>n270</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>coreduo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>core2duo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>athlon</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Westmere</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Snowridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Penryn</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G5</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G4</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Opteron_G1</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Nehalem</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Rome</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Milan</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Dhyana</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cooperlake</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Conroe</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>486</model>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:   </cpu>
Nov 16 15:12:58 user nova-compute[74658]:   <memoryBacking supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='sourceType'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>file</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>anonymous</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>memfd</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:   </memoryBacking>
Nov 16 15:12:58 user nova-compute[74658]:   <devices>
Nov 16 15:12:58 user nova-compute[74658]:     <disk supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='diskDevice'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>disk</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cdrom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>floppy</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>lun</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='bus'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>fdc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sata</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </disk>
Nov 16 15:12:58 user nova-compute[74658]:     <graphics supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sdl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vnc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>spice</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egl-headless</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </graphics>
Nov 16 15:12:58 user nova-compute[74658]:     <video supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='modelType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cirrus</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vmvga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>qxl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>none</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>bochs</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ramfb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </video>
Nov 16 15:12:58 user nova-compute[74658]:     <hostdev supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='mode'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>subsystem</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='startupPolicy'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>default</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>mandatory</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>requisite</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>optional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='subsysType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pci</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='capsType'/>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='pciBackend'/>
Nov 16 15:12:58 user nova-compute[74658]:     </hostdev>
Nov 16 15:12:58 user nova-compute[74658]:     <rng supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>random</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egd</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>builtin</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </rng>
Nov 16 15:12:58 user nova-compute[74658]:     <filesystem supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='driverType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>path</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>handle</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtiofs</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </filesystem>
Nov 16 15:12:58 user nova-compute[74658]:     <tpm supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-tis</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-crb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>passthrough</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>emulator</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </tpm>
Nov 16 15:12:58 user nova-compute[74658]:   </devices>
Nov 16 15:12:58 user nova-compute[74658]:   <features>
Nov 16 15:12:58 user nova-compute[74658]:     <gic supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     <vmcoreinfo supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <genid supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backingStoreInput supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backup supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <sev supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:   </features>
Nov 16 15:12:58 user nova-compute[74658]: </domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:  {{(pid=74658) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 16 15:12:58 user nova-compute[74658]: <domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 15:12:58 user nova-compute[74658]:   <domain>kvm</domain>
Nov 16 15:12:58 user nova-compute[74658]:   <machine>pc-q35-6.2</machine>
Nov 16 15:12:58 user nova-compute[74658]:   <arch>x86_64</arch>
Nov 16 15:12:58 user nova-compute[74658]:   <vcpu max='288'/>
Nov 16 15:12:58 user nova-compute[74658]:   <iothreads supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:   <os supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='firmware'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>efi</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:     <loader supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>rom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pflash</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='readonly'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>yes</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='secure'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>yes</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </loader>
Nov 16 15:12:58 user nova-compute[74658]:   </os>
Nov 16 15:12:58 user nova-compute[74658]:   <cpu>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-passthrough' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='hostPassthroughMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='maximum' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='maximumMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-model' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <vendor>Intel</vendor>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ss'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='vmx'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pcid'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='hypervisor'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arat'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='umip'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='md-clear'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='invtsc'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibpb'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibrs'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='rsba'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='erms'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='custom' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>qemu64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>qemu32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>phenom</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>n270</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>coreduo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>core2duo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>athlon</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Westmere</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Snowridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Penryn</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G5</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G4</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Opteron_G1</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Nehalem</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Rome</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Milan</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Dhyana</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cooperlake</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Conroe</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>486</model>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:   </cpu>
Nov 16 15:12:58 user nova-compute[74658]:   <memoryBacking supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='sourceType'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>file</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>anonymous</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>memfd</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:   </memoryBacking>
Nov 16 15:12:58 user nova-compute[74658]:   <devices>
Nov 16 15:12:58 user nova-compute[74658]:     <disk supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='diskDevice'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>disk</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cdrom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>floppy</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>lun</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='bus'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>fdc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sata</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </disk>
Nov 16 15:12:58 user nova-compute[74658]:     <graphics supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sdl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vnc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>spice</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egl-headless</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </graphics>
Nov 16 15:12:58 user nova-compute[74658]:     <video supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='modelType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cirrus</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vmvga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>qxl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>none</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>bochs</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ramfb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </video>
Nov 16 15:12:58 user nova-compute[74658]:     <hostdev supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='mode'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>subsystem</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='startupPolicy'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>default</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>mandatory</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>requisite</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>optional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='subsysType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pci</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='capsType'/>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='pciBackend'/>
Nov 16 15:12:58 user nova-compute[74658]:     </hostdev>
Nov 16 15:12:58 user nova-compute[74658]:     <rng supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>random</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egd</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>builtin</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </rng>
Nov 16 15:12:58 user nova-compute[74658]:     <filesystem supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='driverType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>path</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>handle</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtiofs</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </filesystem>
Nov 16 15:12:58 user nova-compute[74658]:     <tpm supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-tis</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-crb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>passthrough</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>emulator</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </tpm>
Nov 16 15:12:58 user nova-compute[74658]:   </devices>
Nov 16 15:12:58 user nova-compute[74658]:   <features>
Nov 16 15:12:58 user nova-compute[74658]:     <gic supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     <vmcoreinfo supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <genid supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backingStoreInput supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backup supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <sev supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:   </features>
Nov 16 15:12:58 user nova-compute[74658]: </domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:  {{(pid=74658) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 16 15:12:58 user nova-compute[74658]: <domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 15:12:58 user nova-compute[74658]:   <domain>kvm</domain>
Nov 16 15:12:58 user nova-compute[74658]:   <machine>pc-i440fx-jammy</machine>
Nov 16 15:12:58 user nova-compute[74658]:   <arch>x86_64</arch>
Nov 16 15:12:58 user nova-compute[74658]:   <vcpu max='255'/>
Nov 16 15:12:58 user nova-compute[74658]:   <iothreads supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:   <os supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='firmware'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>efi</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:     <loader supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>rom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pflash</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='readonly'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>yes</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='secure'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>no</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </loader>
Nov 16 15:12:58 user nova-compute[74658]:   </os>
Nov 16 15:12:58 user nova-compute[74658]:   <cpu>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-passthrough' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='hostPassthroughMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='maximum' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='maximumMigratable'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>on</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>off</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='host-model' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <vendor>Intel</vendor>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ss'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='vmx'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pcid'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='hypervisor'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arat'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='umip'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='md-clear'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='invtsc'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibpb'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='ibrs'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-stibp'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='rsba'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='erms'/>
Nov 16 15:12:58 user nova-compute[74658]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:     <mode name='custom' supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>qemu64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>qemu32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>phenom</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>pentium</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>n270</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm64</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>kvm32</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>coreduo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>core2duo</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>athlon</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Westmere</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Snowridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Skylake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>SandyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Penryn</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G5</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G4</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G3</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Opteron_G2</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Opteron_G1</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Nehalem</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>IvyBridge</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Icelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Haswell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Rome</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-Milan</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>EPYC</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Dhyana</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cooperlake</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>Conroe</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='no'>Broadwell</model>
Nov 16 15:12:58 user nova-compute[74658]:       <model usable='yes'>486</model>
Nov 16 15:12:58 user nova-compute[74658]:     </mode>
Nov 16 15:12:58 user nova-compute[74658]:   </cpu>
Nov 16 15:12:58 user nova-compute[74658]:   <memoryBacking supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:     <enum name='sourceType'>
Nov 16 15:12:58 user nova-compute[74658]:       <value>file</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>anonymous</value>
Nov 16 15:12:58 user nova-compute[74658]:       <value>memfd</value>
Nov 16 15:12:58 user nova-compute[74658]:     </enum>
Nov 16 15:12:58 user nova-compute[74658]:   </memoryBacking>
Nov 16 15:12:58 user nova-compute[74658]:   <devices>
Nov 16 15:12:58 user nova-compute[74658]:     <disk supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='diskDevice'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>disk</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cdrom</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>floppy</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>lun</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='bus'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ide</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>fdc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sata</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </disk>
Nov 16 15:12:58 user nova-compute[74658]:     <graphics supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='type'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>sdl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vnc</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>spice</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egl-headless</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </graphics>
Nov 16 15:12:58 user nova-compute[74658]:     <video supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='modelType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>cirrus</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>vmvga</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>qxl</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>none</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>bochs</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>ramfb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </video>
Nov 16 15:12:58 user nova-compute[74658]:     <hostdev supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='mode'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>subsystem</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='startupPolicy'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>default</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>mandatory</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>requisite</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>optional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='subsysType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>usb</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>pci</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>scsi</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='capsType'/>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='pciBackend'/>
Nov 16 15:12:58 user nova-compute[74658]:     </hostdev>
Nov 16 15:12:58 user nova-compute[74658]:     <rng supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtio-non-transitional</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>random</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>egd</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>builtin</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </rng>
Nov 16 15:12:58 user nova-compute[74658]:     <filesystem supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='driverType'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>path</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>handle</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>virtiofs</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </filesystem>
Nov 16 15:12:58 user nova-compute[74658]:     <tpm supported='yes'>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='model'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-tis</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>tpm-crb</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:       <enum name='backendModel'>
Nov 16 15:12:58 user nova-compute[74658]:         <value>passthrough</value>
Nov 16 15:12:58 user nova-compute[74658]:         <value>emulator</value>
Nov 16 15:12:58 user nova-compute[74658]:       </enum>
Nov 16 15:12:58 user nova-compute[74658]:     </tpm>
Nov 16 15:12:58 user nova-compute[74658]:   </devices>
Nov 16 15:12:58 user nova-compute[74658]:   <features>
Nov 16 15:12:58 user nova-compute[74658]:     <gic supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:     <vmcoreinfo supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <genid supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backingStoreInput supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <backup supported='yes'/>
Nov 16 15:12:58 user nova-compute[74658]:     <sev supported='no'/>
Nov 16 15:12:58 user nova-compute[74658]:   </features>
Nov 16 15:12:58 user nova-compute[74658]: </domainCapabilities>
Nov 16 15:12:58 user nova-compute[74658]:  {{(pid=74658) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74658) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74658) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Checking secure boot support for host arch (x86_64) {{(pid=74658) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Checking secure boot support for host arch (x86_64) {{(pid=74658) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Checking secure boot support for host arch (x86_64) {{(pid=74658) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 15:12:58 user nova-compute[74658]: INFO nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Secure Boot support detected
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] cpu compare xml: <cpu match="exact">
Nov 16 15:12:58 user nova-compute[74658]:   <model>Nehalem</model>
Nov 16 15:12:58 user nova-compute[74658]: </cpu>
Nov 16 15:12:58 user nova-compute[74658]:  {{(pid=74658) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 16 15:12:58 user nova-compute[74658]: INFO nova.virt.node [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Generated node identity 16aee638-e9e1-41bd-94a9-c6d2aeb81dee
Nov 16 15:12:58 user nova-compute[74658]: INFO nova.virt.node [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Wrote node identity 16aee638-e9e1-41bd-94a9-c6d2aeb81dee to /opt/stack/data/nova/compute_id
Nov 16 15:12:58 user nova-compute[74658]: WARNING nova.compute.manager [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Compute nodes ['16aee638-e9e1-41bd-94a9-c6d2aeb81dee'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 16 15:12:58 user nova-compute[74658]: INFO nova.compute.manager [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 16 15:12:58 user nova-compute[74658]: WARNING nova.compute.manager [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 15:12:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:12:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:12:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Hypervisor/Node resource view: name=user free_ram=11015MB free_disk=26.287452697753906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:12:58 user nova-compute[74658]: WARNING nova.compute.resource_tracker [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] No compute node record for user:16aee638-e9e1-41bd-94a9-c6d2aeb81dee: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 16aee638-e9e1-41bd-94a9-c6d2aeb81dee could not be found.
Nov 16 15:12:58 user nova-compute[74658]: INFO nova.compute.resource_tracker [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Compute node record created for user:user with uuid: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:12:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:12:59 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] [req-c8208358-7b54-44b9-8696-c8b49118b08e] Created resource provider record via placement API for resource provider with UUID 16aee638-e9e1-41bd-94a9-c6d2aeb81dee and name user.
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74658) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 16 15:12:59 user nova-compute[74658]: INFO nova.virt.libvirt.host [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] kernel doesn't support AMD SEV
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Libvirt baseline CPU <cpu>
Nov 16 15:12:59 user nova-compute[74658]:   <arch>x86_64</arch>
Nov 16 15:12:59 user nova-compute[74658]:   <model>Nehalem</model>
Nov 16 15:12:59 user nova-compute[74658]:   <vendor>Intel</vendor>
Nov 16 15:12:59 user nova-compute[74658]:   <topology sockets="6" cores="1" threads="1"/>
Nov 16 15:12:59 user nova-compute[74658]: </cpu>
Nov 16 15:12:59 user nova-compute[74658]:  {{(pid=74658) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Updated inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Updating resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee generation from 0 to 1 during operation: update_inventory {{(pid=74658) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Updating resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee generation from 1 to 2 during operation: update_traits {{(pid=74658) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:12:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.service [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Creating RPC server for service compute {{(pid=74658) start /opt/stack/nova/nova/service.py:182}}
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.service [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] Join ServiceGroup membership for this service compute {{(pid=74658) start /opt/stack/nova/nova/service.py:199}}
Nov 16 15:12:59 user nova-compute[74658]: DEBUG nova.servicegroup.drivers.db [None req-d17356fd-fb65-42cb-a6d3-82c0c097555d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74658) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 16 15:13:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_power_states {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:13:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:13:50 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:13:50 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:13:50 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=10436MB free_disk=26.191207885742188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:13:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:14:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:14:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:14:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:14:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:14:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:14:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:14:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:14:50 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:14:51 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:14:51 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:14:51 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=10381MB free_disk=26.255821228027344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:14:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:14:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:14:51 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:14:51 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:14:51 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:14:51 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:14:51 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:14:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:14:51 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:14:51 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:14:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:14:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:14:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:14:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 15:14:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:14:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:14:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:14:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:15:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:15:51 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:15:51 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:15:51 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=10358MB free_disk=26.008056640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:15:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:15:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:15:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:15:53 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:15:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:15:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:15:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 15:15:53 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:15:53 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:15:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:15:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:16:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:16:51 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:16:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:16:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:16:53 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:16:53 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:16:53 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9687MB free_disk=26.02855682373047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:16:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:16:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:16:55 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:16:55 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:16:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:17:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "7ef751d1-099a-4b46-b08d-99929d449ef9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:17:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:17:02 user nova-compute[74658]: INFO nova.compute.claims [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Claim successful on node user
Nov 16 15:17:02 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:17:03 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:17:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:17:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:17:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:17:03 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:17:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:17:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:17:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:17:03 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Creating image(s)
Nov 16 15:17:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "/opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "/opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2.part --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG nova.policy [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8507e72d5b248cd8a6a8b9bea6733cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b189fdeea224d4dbdc2923041dc8e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2.part --force-share --output=json" returned: 0 in 0.209s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG nova.virt.images [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] aca440dd-4b6f-4e54-990c-d8198a375081 was qcow2, converting to raw {{(pid=74658) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2.part /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2.converted {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:17:04 user nova-compute[74658]: INFO nova.compute.claims [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Claim successful on node user
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2.part /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2.converted" returned: 0 in 0.246s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2.converted --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.507s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:04 user nova-compute[74658]: INFO oslo.privsep.daemon [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfr6zkqbw/privsep.sock']
Nov 16 15:17:04 user sudo[83939]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfr6zkqbw/privsep.sock
Nov 16 15:17:04 user sudo[83939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 15:17:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:17:04 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:17:05 user nova-compute[74658]: INFO nova.compute.claims [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Claim successful on node user
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.network.neutron [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:17:05 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.policy [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3ab7f89ab8d49c2a0f526c4c09a3b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af743d7342e44f64ae98c2d596eb63b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:17:05 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Creating image(s)
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "/opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "/opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "/opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.244s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:17:05 user nova-compute[74658]: INFO nova.compute.claims [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Claim successful on node user
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.network.neutron [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:17:05 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.policy [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecc78ceda36b43fc91a920894e5228a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d64a18a74e140f0bd504f507af25d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:17:05 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Creating image(s)
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "/opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "/opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:17:06 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:17:06 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:17:06 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Creating image(s)
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "/opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "/opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "/opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:06 user sudo[83939]: pam_unix(sudo:session): session closed for user root
Nov 16 15:17:06 user nova-compute[74658]: DEBUG nova.policy [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01ee1cb04054422e9e93a271b5b3d68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59693f6c93045eb86ae04a661060b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:17:06 user nova-compute[74658]: INFO oslo.privsep.daemon [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Spawned new privsep daemon via rootwrap
Nov 16 15:17:06 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 15:17:06 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 15:17:06 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 16 15:17:06 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83946
Nov 16 15:17:06 user nova-compute[74658]: WARNING oslo_privsep.priv_context [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] privsep daemon already running
Nov 16 15:17:06 user nova-compute[74658]: WARNING oslo_privsep.priv_context [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] privsep daemon already running
Nov 16 15:17:06 user nova-compute[74658]: WARNING oslo_privsep.priv_context [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] privsep daemon already running
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.187s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG nova.network.neutron [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Successfully created port: 02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.206s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk 1073741824" returned: 0 in 0.043s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.229s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk 1073741824" returned: 0 in 0.065s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.448s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Cannot resize image /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Ensure instance console log exists: /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.network.neutron [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Successfully created port: 9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.network.neutron [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Successfully created port: 4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.204s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk 1073741824" returned: 0 in 0.045s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.737s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Cannot resize image /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Ensure instance console log exists: /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.222s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.224s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk 1073741824" returned: 0 in 0.044s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Cannot resize image /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Ensure instance console log exists: /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:17:08 user nova-compute[74658]: INFO nova.compute.claims [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Claim successful on node user
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Cannot resize image /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Ensure instance console log exists: /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.network.neutron [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Successfully updated port: 02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "refresh_cache-c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquired lock "refresh_cache-c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.network.neutron [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.network.neutron [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.network.neutron [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:17:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:17:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Creating image(s)
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "/opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "/opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "/opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.policy [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9aa837a8e0f14644a3b6b0d3904213f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e465eeac8f4bc5b11c0a6e3a7bbc61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-15b3e719-6ad7-4477-9c73-66d9437efc7b req-6c023ca7-2fad-4b5e-a132-61139b98c8d9 service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Received event network-changed-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-15b3e719-6ad7-4477-9c73-66d9437efc7b req-6c023ca7-2fad-4b5e-a132-61139b98c8d9 service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Refreshing instance network info cache due to event network-changed-02cef59c-80d7-4bcf-8882-a735ddfcdfe3. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-15b3e719-6ad7-4477-9c73-66d9437efc7b req-6c023ca7-2fad-4b5e-a132-61139b98c8d9 service nova] Acquiring lock "refresh_cache-c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:08 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Successfully created port: a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Updating instance_info_cache with network_info: [{"id": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "address": "fa:16:3e:b4:11:7c", "network": {"id": "00a603e3-db94-4fd7-b030-afd4420ba72a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-164747889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d64a18a74e140f0bd504f507af25d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cef59c-80", "ovs_interfaceid": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Releasing lock "refresh_cache-c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Instance network_info: |[{"id": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "address": "fa:16:3e:b4:11:7c", "network": {"id": "00a603e3-db94-4fd7-b030-afd4420ba72a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-164747889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d64a18a74e140f0bd504f507af25d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cef59c-80", "ovs_interfaceid": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-15b3e719-6ad7-4477-9c73-66d9437efc7b req-6c023ca7-2fad-4b5e-a132-61139b98c8d9 service nova] Acquired lock "refresh_cache-c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.neutron [req-15b3e719-6ad7-4477-9c73-66d9437efc7b req-6c023ca7-2fad-4b5e-a132-61139b98c8d9 service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Refreshing network info cache for port 02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Start _get_guest_xml network_info=[{"id": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "address": "fa:16:3e:b4:11:7c", "network": {"id": "00a603e3-db94-4fd7-b030-afd4420ba72a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-164747889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d64a18a74e140f0bd504f507af25d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cef59c-80", "ovs_interfaceid": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk 1073741824" returned: 0 in 0.062s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:09 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:09 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2003535367',display_name='tempest-DeleteServersTestJSON-server-2003535367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2003535367',id=3,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d64a18a74e140f0bd504f507af25d6d',ramdisk_id='',reservation_id='r-vfcgq5df',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-896359217',owner_user_name='tempest-DeleteServersTestJSON-896359217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:06Z,user_data=None,user_id='ecc78ceda36b43fc91a920894e5228a4',uuid=c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "address": "fa:16:3e:b4:11:7c", "network": {"id": "00a603e3-db94-4fd7-b030-afd4420ba72a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-164747889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d64a18a74e140f0bd504f507af25d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cef59c-80", "ovs_interfaceid": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Converting VIF {"id": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "address": "fa:16:3e:b4:11:7c", "network": {"id": "00a603e3-db94-4fd7-b030-afd4420ba72a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-164747889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d64a18a74e140f0bd504f507af25d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cef59c-80", "ovs_interfaceid": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=02cef59c-80d7-4bcf-8882-a735ddfcdfe3,network=Network(00a603e3-db94-4fd7-b030-afd4420ba72a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cef59c-80') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.objects.instance [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lazy-loading 'pci_devices' on Instance uuid c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Successfully updated port: 4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:17:09 user nova-compute[74658]:   <uuid>c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37</uuid>
Nov 16 15:17:09 user nova-compute[74658]:   <name>instance-00000003</name>
Nov 16 15:17:09 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:17:09 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:17:09 user nova-compute[74658]:   <metadata>
Nov 16 15:17:09 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:17:09 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:name>tempest-DeleteServersTestJSON-server-2003535367</nova:name>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:17:09</nova:creationTime>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:17:09 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:17:09 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:owner>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:user uuid="ecc78ceda36b43fc91a920894e5228a4">tempest-DeleteServersTestJSON-896359217-project-member</nova:user>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:project uuid="6d64a18a74e140f0bd504f507af25d6d">tempest-DeleteServersTestJSON-896359217</nova:project>
Nov 16 15:17:09 user nova-compute[74658]:       </nova:owner>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:ports>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:port uuid="02cef59c-80d7-4bcf-8882-a735ddfcdfe3">
Nov 16 15:17:09 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 15:17:09 user nova-compute[74658]:         </nova:port>
Nov 16 15:17:09 user nova-compute[74658]:       </nova:ports>
Nov 16 15:17:09 user nova-compute[74658]:     </nova:instance>
Nov 16 15:17:09 user nova-compute[74658]:   </metadata>
Nov 16 15:17:09 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:17:09 user nova-compute[74658]:     <system>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="serial">c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37</entry>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="uuid">c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37</entry>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:17:09 user nova-compute[74658]:     </system>
Nov 16 15:17:09 user nova-compute[74658]:   </sysinfo>
Nov 16 15:17:09 user nova-compute[74658]:   <os>
Nov 16 15:17:09 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:17:09 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:17:09 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:17:09 user nova-compute[74658]:   </os>
Nov 16 15:17:09 user nova-compute[74658]:   <features>
Nov 16 15:17:09 user nova-compute[74658]:     <acpi/>
Nov 16 15:17:09 user nova-compute[74658]:     <apic/>
Nov 16 15:17:09 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:17:09 user nova-compute[74658]:   </features>
Nov 16 15:17:09 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:17:09 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:17:09 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:17:09 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:17:09 user nova-compute[74658]:   </clock>
Nov 16 15:17:09 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:17:09 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:17:09 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:17:09 user nova-compute[74658]:   </cpu>
Nov 16 15:17:09 user nova-compute[74658]:   <devices>
Nov 16 15:17:09 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:17:09 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:17:09 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk"/>
Nov 16 15:17:09 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:17:09 user nova-compute[74658]:     </disk>
Nov 16 15:17:09 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:17:09 user nova-compute[74658]:       <mac address="fa:16:3e:b4:11:7c"/>
Nov 16 15:17:09 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:09 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:17:09 user nova-compute[74658]:       <target dev="tap02cef59c-80"/>
Nov 16 15:17:09 user nova-compute[74658]:     </interface>
Nov 16 15:17:09 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:17:09 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/console.log" append="off"/>
Nov 16 15:17:09 user nova-compute[74658]:     </serial>
Nov 16 15:17:09 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:17:09 user nova-compute[74658]:     <video>
Nov 16 15:17:09 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:09 user nova-compute[74658]:     </video>
Nov 16 15:17:09 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:17:09 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:17:09 user nova-compute[74658]:     </rng>
Nov 16 15:17:09 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:17:09 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:17:09 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:17:09 user nova-compute[74658]:     </memballoon>
Nov 16 15:17:09 user nova-compute[74658]:   </devices>
Nov 16 15:17:09 user nova-compute[74658]: </domain>
Nov 16 15:17:09 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2003535367',display_name='tempest-DeleteServersTestJSON-server-2003535367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2003535367',id=3,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d64a18a74e140f0bd504f507af25d6d',ramdisk_id='',reservation_id='r-vfcgq5df',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-896359217',owner_user_name='tempest-DeleteServersTestJSON-896359217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:06Z,user_data=None,user_id='ecc78ceda36b43fc91a920894e5228a4',uuid=c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "address": "fa:16:3e:b4:11:7c", "network": {"id": "00a603e3-db94-4fd7-b030-afd4420ba72a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-164747889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d64a18a74e140f0bd504f507af25d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cef59c-80", "ovs_interfaceid": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Converting VIF {"id": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "address": "fa:16:3e:b4:11:7c", "network": {"id": "00a603e3-db94-4fd7-b030-afd4420ba72a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-164747889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d64a18a74e140f0bd504f507af25d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cef59c-80", "ovs_interfaceid": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=02cef59c-80d7-4bcf-8882-a735ddfcdfe3,network=Network(00a603e3-db94-4fd7-b030-afd4420ba72a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cef59c-80') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG os_vif [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=02cef59c-80d7-4bcf-8882-a735ddfcdfe3,network=Network(00a603e3-db94-4fd7-b030-afd4420ba72a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cef59c-80') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquired lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.203s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Created schema index Interface.name {{(pid=74658) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Created schema index Port.name {{(pid=74658) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Created schema index Bridge.name {{(pid=74658) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [POLLOUT] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14d840fd-cf8d-549e-94ca-09eb1deb4a97', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:09 user nova-compute[74658]: INFO oslo.privsep.daemon [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmptlz2qkcg/privsep.sock']
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-e78e0557-64c9-41ad-b01d-9e2a9f718f22 req-df8c78aa-9a8c-49fe-8a36-27b29bca46a5 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received event network-changed-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-e78e0557-64c9-41ad-b01d-9e2a9f718f22 req-df8c78aa-9a8c-49fe-8a36-27b29bca46a5 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Refreshing instance network info cache due to event network-changed-4999888f-3310-45f7-bc33-8180b8110ef9. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e78e0557-64c9-41ad-b01d-9e2a9f718f22 req-df8c78aa-9a8c-49fe-8a36-27b29bca46a5 service nova] Acquiring lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:17:09 user sudo[84037]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmptlz2qkcg/privsep.sock
Nov 16 15:17:09 user sudo[84037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Cannot resize image /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Ensure instance console log exists: /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updating instance_info_cache with network_info: [{"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Releasing lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Instance network_info: |[{"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e78e0557-64c9-41ad-b01d-9e2a9f718f22 req-df8c78aa-9a8c-49fe-8a36-27b29bca46a5 service nova] Acquired lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.neutron [req-e78e0557-64c9-41ad-b01d-9e2a9f718f22 req-df8c78aa-9a8c-49fe-8a36-27b29bca46a5 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Refreshing network info cache for port 4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Start _get_guest_xml network_info=[{"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:17:09 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:09 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-961291666',display_name='tempest-ServerActionsTestOtherA-server-961291666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-961291666',id=1,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfs3x9tKyy9KHJUedCxh49P9LH14YRsacTcDaxEVd8YqO4Cuyb8pJja3XT1OhFAuM946OKuatB2JwDtDIzcfi6ebK97F+SRlzAxuSg9qPWnSDGTyfFCtkcgNG6s/nMQMw==',key_name='tempest-keypair-1686675082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-g481z6r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=7ef751d1-099a-4b46-b08d-99929d449ef9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=4999888f-3310-45f7-bc33-8180b8110ef9,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4999888f-33') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.objects.instance [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ef751d1-099a-4b46-b08d-99929d449ef9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:17:09 user nova-compute[74658]:   <uuid>7ef751d1-099a-4b46-b08d-99929d449ef9</uuid>
Nov 16 15:17:09 user nova-compute[74658]:   <name>instance-00000001</name>
Nov 16 15:17:09 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:17:09 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:17:09 user nova-compute[74658]:   <metadata>
Nov 16 15:17:09 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:17:09 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:name>tempest-ServerActionsTestOtherA-server-961291666</nova:name>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:17:09</nova:creationTime>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:17:09 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:17:09 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:owner>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:user uuid="d8507e72d5b248cd8a6a8b9bea6733cb">tempest-ServerActionsTestOtherA-1362925052-project-member</nova:user>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:project uuid="6b189fdeea224d4dbdc2923041dc8e75">tempest-ServerActionsTestOtherA-1362925052</nova:project>
Nov 16 15:17:09 user nova-compute[74658]:       </nova:owner>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:17:09 user nova-compute[74658]:       <nova:ports>
Nov 16 15:17:09 user nova-compute[74658]:         <nova:port uuid="4999888f-3310-45f7-bc33-8180b8110ef9">
Nov 16 15:17:09 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 15:17:09 user nova-compute[74658]:         </nova:port>
Nov 16 15:17:09 user nova-compute[74658]:       </nova:ports>
Nov 16 15:17:09 user nova-compute[74658]:     </nova:instance>
Nov 16 15:17:09 user nova-compute[74658]:   </metadata>
Nov 16 15:17:09 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:17:09 user nova-compute[74658]:     <system>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="serial">7ef751d1-099a-4b46-b08d-99929d449ef9</entry>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="uuid">7ef751d1-099a-4b46-b08d-99929d449ef9</entry>
Nov 16 15:17:09 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:17:09 user nova-compute[74658]:     </system>
Nov 16 15:17:09 user nova-compute[74658]:   </sysinfo>
Nov 16 15:17:09 user nova-compute[74658]:   <os>
Nov 16 15:17:09 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:17:09 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:17:09 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:17:09 user nova-compute[74658]:   </os>
Nov 16 15:17:09 user nova-compute[74658]:   <features>
Nov 16 15:17:09 user nova-compute[74658]:     <acpi/>
Nov 16 15:17:09 user nova-compute[74658]:     <apic/>
Nov 16 15:17:09 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:17:09 user nova-compute[74658]:   </features>
Nov 16 15:17:09 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:17:09 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:17:09 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:17:09 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:17:09 user nova-compute[74658]:   </clock>
Nov 16 15:17:09 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:17:09 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:17:09 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:17:09 user nova-compute[74658]:   </cpu>
Nov 16 15:17:09 user nova-compute[74658]:   <devices>
Nov 16 15:17:09 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:17:09 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:17:09 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk"/>
Nov 16 15:17:09 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:17:09 user nova-compute[74658]:     </disk>
Nov 16 15:17:09 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:17:09 user nova-compute[74658]:       <mac address="fa:16:3e:dc:68:8b"/>
Nov 16 15:17:09 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:09 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:17:09 user nova-compute[74658]:       <target dev="tap4999888f-33"/>
Nov 16 15:17:09 user nova-compute[74658]:     </interface>
Nov 16 15:17:09 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:17:09 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/console.log" append="off"/>
Nov 16 15:17:09 user nova-compute[74658]:     </serial>
Nov 16 15:17:09 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:17:09 user nova-compute[74658]:     <video>
Nov 16 15:17:09 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:09 user nova-compute[74658]:     </video>
Nov 16 15:17:09 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:17:09 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:17:09 user nova-compute[74658]:     </rng>
Nov 16 15:17:09 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:17:09 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:17:09 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:17:09 user nova-compute[74658]:     </memballoon>
Nov 16 15:17:09 user nova-compute[74658]:   </devices>
Nov 16 15:17:09 user nova-compute[74658]: </domain>
Nov 16 15:17:09 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-961291666',display_name='tempest-ServerActionsTestOtherA-server-961291666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-961291666',id=1,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfs3x9tKyy9KHJUedCxh49P9LH14YRsacTcDaxEVd8YqO4Cuyb8pJja3XT1OhFAuM946OKuatB2JwDtDIzcfi6ebK97F+SRlzAxuSg9qPWnSDGTyfFCtkcgNG6s/nMQMw==',key_name='tempest-keypair-1686675082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-g481z6r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=7ef751d1-099a-4b46-b08d-99929d449ef9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=4999888f-3310-45f7-bc33-8180b8110ef9,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4999888f-33') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG os_vif [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=4999888f-3310-45f7-bc33-8180b8110ef9,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4999888f-33') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41f601b0-535a-5029-a40e-7a7201de8851', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Successfully updated port: 9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquired lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG nova.network.neutron [req-e78e0557-64c9-41ad-b01d-9e2a9f718f22 req-df8c78aa-9a8c-49fe-8a36-27b29bca46a5 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updated VIF entry in instance network info cache for port 4999888f-3310-45f7-bc33-8180b8110ef9. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG nova.network.neutron [req-e78e0557-64c9-41ad-b01d-9e2a9f718f22 req-df8c78aa-9a8c-49fe-8a36-27b29bca46a5 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updating instance_info_cache with network_info: [{"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e78e0557-64c9-41ad-b01d-9e2a9f718f22 req-df8c78aa-9a8c-49fe-8a36-27b29bca46a5 service nova] Releasing lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-3b9532b5-c2ee-42e6-a6d9-5c9ede69c441 req-8a311bc4-06c4-4a5b-a739-84fe76f857f7 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Received event network-changed-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-3b9532b5-c2ee-42e6-a6d9-5c9ede69c441 req-8a311bc4-06c4-4a5b-a739-84fe76f857f7 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Refreshing instance network info cache due to event network-changed-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3b9532b5-c2ee-42e6-a6d9-5c9ede69c441 req-8a311bc4-06c4-4a5b-a739-84fe76f857f7 service nova] Acquiring lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG nova.network.neutron [req-15b3e719-6ad7-4477-9c73-66d9437efc7b req-6c023ca7-2fad-4b5e-a132-61139b98c8d9 service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Updated VIF entry in instance network info cache for port 02cef59c-80d7-4bcf-8882-a735ddfcdfe3. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG nova.network.neutron [req-15b3e719-6ad7-4477-9c73-66d9437efc7b req-6c023ca7-2fad-4b5e-a132-61139b98c8d9 service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Updating instance_info_cache with network_info: [{"id": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "address": "fa:16:3e:b4:11:7c", "network": {"id": "00a603e3-db94-4fd7-b030-afd4420ba72a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-164747889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d64a18a74e140f0bd504f507af25d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cef59c-80", "ovs_interfaceid": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-15b3e719-6ad7-4477-9c73-66d9437efc7b req-6c023ca7-2fad-4b5e-a132-61139b98c8d9 service nova] Releasing lock "refresh_cache-c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:10 user sudo[84037]: pam_unix(sudo:session): session closed for user root
Nov 16 15:17:10 user nova-compute[74658]: INFO oslo.privsep.daemon [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Spawned new privsep daemon via rootwrap
Nov 16 15:17:10 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 15:17:10 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 15:17:10 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 16 15:17:10 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84052
Nov 16 15:17:10 user nova-compute[74658]: WARNING oslo_privsep.priv_context [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] privsep daemon already running
Nov 16 15:17:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Successfully created port: 6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02cef59c-80, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02cef59c-80, col_values=(('qos', UUID('faef48f3-91d0-4736-a5d2-198ce209a146')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02cef59c-80, col_values=(('external_ids', {'iface-id': '02cef59c-80d7-4bcf-8882-a735ddfcdfe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:11:7c', 'vm-uuid': 'c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: INFO os_vif [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=02cef59c-80d7-4bcf-8882-a735ddfcdfe3,network=Network(00a603e3-db94-4fd7-b030-afd4420ba72a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cef59c-80')
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4999888f-33, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4999888f-33, col_values=(('qos', UUID('3ece84f9-4e5c-4688-8fde-2d61438ba376')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4999888f-33, col_values=(('external_ids', {'iface-id': '4999888f-3310-45f7-bc33-8180b8110ef9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:68:8b', 'vm-uuid': '7ef751d1-099a-4b46-b08d-99929d449ef9'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: INFO os_vif [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=4999888f-3310-45f7-bc33-8180b8110ef9,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4999888f-33')
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] No VIF found with MAC fa:16:3e:b4:11:7c, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No VIF found with MAC fa:16:3e:dc:68:8b, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Updating instance_info_cache with network_info: [{"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Releasing lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Instance network_info: |[{"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3b9532b5-c2ee-42e6-a6d9-5c9ede69c441 req-8a311bc4-06c4-4a5b-a739-84fe76f857f7 service nova] Acquired lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.network.neutron [req-3b9532b5-c2ee-42e6-a6d9-5c9ede69c441 req-8a311bc4-06c4-4a5b-a739-84fe76f857f7 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Refreshing network info cache for port 9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Start _get_guest_xml network_info=[{"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:17:11 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:11 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-875708792',display_name='tempest-ServersNegativeTestJSON-server-875708792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-875708792',id=2,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af743d7342e44f64ae98c2d596eb63b1',ramdisk_id='',reservation_id='r-haczks62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-143070094',owner_user_name='tempest-ServersNegativeTestJSON-143070094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:05Z,user_data=None,user_id='d3ab7f89ab8d49c2a0f526c4c09a3b94',uuid=03cbebbf-5414-4309-bfc1-ec0a67e09a7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converting VIF {"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:18:cf,bridge_name='br-int',has_traffic_filtering=True,id=9b19cdcb-6717-4eab-bf59-01a9dae6ffe4,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b19cdcb-67') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.objects.instance [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lazy-loading 'pci_devices' on Instance uuid 03cbebbf-5414-4309-bfc1-ec0a67e09a7c {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:17:11 user nova-compute[74658]:   <uuid>03cbebbf-5414-4309-bfc1-ec0a67e09a7c</uuid>
Nov 16 15:17:11 user nova-compute[74658]:   <name>instance-00000002</name>
Nov 16 15:17:11 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:17:11 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:17:11 user nova-compute[74658]:   <metadata>
Nov 16 15:17:11 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:17:11 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:17:11 user nova-compute[74658]:       <nova:name>tempest-ServersNegativeTestJSON-server-875708792</nova:name>
Nov 16 15:17:11 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:17:11</nova:creationTime>
Nov 16 15:17:11 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:17:11 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:17:11 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:17:11 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:17:11 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:17:11 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:17:11 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:17:11 user nova-compute[74658]:       <nova:owner>
Nov 16 15:17:11 user nova-compute[74658]:         <nova:user uuid="d3ab7f89ab8d49c2a0f526c4c09a3b94">tempest-ServersNegativeTestJSON-143070094-project-member</nova:user>
Nov 16 15:17:11 user nova-compute[74658]:         <nova:project uuid="af743d7342e44f64ae98c2d596eb63b1">tempest-ServersNegativeTestJSON-143070094</nova:project>
Nov 16 15:17:11 user nova-compute[74658]:       </nova:owner>
Nov 16 15:17:11 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:17:11 user nova-compute[74658]:       <nova:ports>
Nov 16 15:17:11 user nova-compute[74658]:         <nova:port uuid="9b19cdcb-6717-4eab-bf59-01a9dae6ffe4">
Nov 16 15:17:11 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 15:17:11 user nova-compute[74658]:         </nova:port>
Nov 16 15:17:11 user nova-compute[74658]:       </nova:ports>
Nov 16 15:17:11 user nova-compute[74658]:     </nova:instance>
Nov 16 15:17:11 user nova-compute[74658]:   </metadata>
Nov 16 15:17:11 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:17:11 user nova-compute[74658]:     <system>
Nov 16 15:17:11 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:17:11 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:17:11 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:17:11 user nova-compute[74658]:       <entry name="serial">03cbebbf-5414-4309-bfc1-ec0a67e09a7c</entry>
Nov 16 15:17:11 user nova-compute[74658]:       <entry name="uuid">03cbebbf-5414-4309-bfc1-ec0a67e09a7c</entry>
Nov 16 15:17:11 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:17:11 user nova-compute[74658]:     </system>
Nov 16 15:17:11 user nova-compute[74658]:   </sysinfo>
Nov 16 15:17:11 user nova-compute[74658]:   <os>
Nov 16 15:17:11 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:17:11 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:17:11 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:17:11 user nova-compute[74658]:   </os>
Nov 16 15:17:11 user nova-compute[74658]:   <features>
Nov 16 15:17:11 user nova-compute[74658]:     <acpi/>
Nov 16 15:17:11 user nova-compute[74658]:     <apic/>
Nov 16 15:17:11 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:17:11 user nova-compute[74658]:   </features>
Nov 16 15:17:11 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:17:11 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:17:11 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:17:11 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:17:11 user nova-compute[74658]:   </clock>
Nov 16 15:17:11 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:17:11 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:17:11 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:17:11 user nova-compute[74658]:   </cpu>
Nov 16 15:17:11 user nova-compute[74658]:   <devices>
Nov 16 15:17:11 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:17:11 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:17:11 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk"/>
Nov 16 15:17:11 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:17:11 user nova-compute[74658]:     </disk>
Nov 16 15:17:11 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:17:11 user nova-compute[74658]:       <mac address="fa:16:3e:83:18:cf"/>
Nov 16 15:17:11 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:11 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:17:11 user nova-compute[74658]:       <target dev="tap9b19cdcb-67"/>
Nov 16 15:17:11 user nova-compute[74658]:     </interface>
Nov 16 15:17:11 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:17:11 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/console.log" append="off"/>
Nov 16 15:17:11 user nova-compute[74658]:     </serial>
Nov 16 15:17:11 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:17:11 user nova-compute[74658]:     <video>
Nov 16 15:17:11 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:11 user nova-compute[74658]:     </video>
Nov 16 15:17:11 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:17:11 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:17:11 user nova-compute[74658]:     </rng>
Nov 16 15:17:11 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:17:11 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:17:11 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:17:11 user nova-compute[74658]:     </memballoon>
Nov 16 15:17:11 user nova-compute[74658]:   </devices>
Nov 16 15:17:11 user nova-compute[74658]: </domain>
Nov 16 15:17:11 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-875708792',display_name='tempest-ServersNegativeTestJSON-server-875708792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-875708792',id=2,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af743d7342e44f64ae98c2d596eb63b1',ramdisk_id='',reservation_id='r-haczks62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-143070094',owner_user_name='tempest-ServersNegativeTestJSON-143070094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:05Z,user_data=None,user_id='d3ab7f89ab8d49c2a0f526c4c09a3b94',uuid=03cbebbf-5414-4309-bfc1-ec0a67e09a7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converting VIF {"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:18:cf,bridge_name='br-int',has_traffic_filtering=True,id=9b19cdcb-6717-4eab-bf59-01a9dae6ffe4,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b19cdcb-67') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG os_vif [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:18:cf,bridge_name='br-int',has_traffic_filtering=True,id=9b19cdcb-6717-4eab-bf59-01a9dae6ffe4,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b19cdcb-67') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3ef217b-8db0-5e2f-a5ff-655a1f8ad704', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b19cdcb-67, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b19cdcb-67, col_values=(('qos', UUID('261f525c-d473-4e3d-b1e7-01b7d783cf51')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b19cdcb-67, col_values=(('external_ids', {'iface-id': '9b19cdcb-6717-4eab-bf59-01a9dae6ffe4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:18:cf', 'vm-uuid': '03cbebbf-5414-4309-bfc1-ec0a67e09a7c'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:11 user nova-compute[74658]: INFO os_vif [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:18:cf,bridge_name='br-int',has_traffic_filtering=True,id=9b19cdcb-6717-4eab-bf59-01a9dae6ffe4,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b19cdcb-67')
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:17:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] No VIF found with MAC fa:16:3e:83:18:cf, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Successfully updated port: a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquired lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-4af4e4ea-a272-4271-8d4e-20cdf25c21d3 req-b4aa4677-e71b-4a5d-84f4-f234d22b67c1 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-changed-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-4af4e4ea-a272-4271-8d4e-20cdf25c21d3 req-b4aa4677-e71b-4a5d-84f4-f234d22b67c1 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Refreshing instance network info cache due to event network-changed-a370fa54-9887-42af-b8e5-ab80c536cccd. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4af4e4ea-a272-4271-8d4e-20cdf25c21d3 req-b4aa4677-e71b-4a5d-84f4-f234d22b67c1 service nova] Acquiring lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG nova.network.neutron [req-3b9532b5-c2ee-42e6-a6d9-5c9ede69c441 req-8a311bc4-06c4-4a5b-a739-84fe76f857f7 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Updated VIF entry in instance network info cache for port 9b19cdcb-6717-4eab-bf59-01a9dae6ffe4. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG nova.network.neutron [req-3b9532b5-c2ee-42e6-a6d9-5c9ede69c441 req-8a311bc4-06c4-4a5b-a739-84fe76f857f7 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Updating instance_info_cache with network_info: [{"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3b9532b5-c2ee-42e6-a6d9-5c9ede69c441 req-8a311bc4-06c4-4a5b-a739-84fe76f857f7 service nova] Releasing lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updating instance_info_cache with network_info: [{"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Releasing lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Instance network_info: |[{"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4af4e4ea-a272-4271-8d4e-20cdf25c21d3 req-b4aa4677-e71b-4a5d-84f4-f234d22b67c1 service nova] Acquired lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG nova.network.neutron [req-4af4e4ea-a272-4271-8d4e-20cdf25c21d3 req-b4aa4677-e71b-4a5d-84f4-f234d22b67c1 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Refreshing network info cache for port a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:17:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Start _get_guest_xml network_info=[{"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:17:13 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:13 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-228686850',display_name='tempest-ServerStableDeviceRescueTest-server-228686850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-228686850',id=4,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVunN5SWyPcwINY6srB+ewdi3nrsftWq/NkFlvGrCChZ5MlRH6RAFPYwHcXxkfPihChhmEuLuesilMmMMfBAuKVH8FxMhGNYqhemohPM52Id5BtJVMJgwtLbhP/0YxsjA==',key_name='tempest-keypair-1727289241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59693f6c93045eb86ae04a661060b9c',ramdisk_id='',reservation_id='r-t43gbh1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-509064368',owner_user_name='tempest-ServerStableDeviceRescueTest-509064368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ee1cb04054422e9e93a271b5b3d68f',uuid=e06fcb99-9271-48da-ac95-3998d45e6ccb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Converting VIF {"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3a:cb,bridge_name='br-int',has_traffic_filtering=True,id=a370fa54-9887-42af-b8e5-ab80c536cccd,network=Network(a84e7dcd-9cee-4b29-85eb-6eb7441efd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa370fa54-98') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.objects.instance [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'pci_devices' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:17:13 user nova-compute[74658]:   <uuid>e06fcb99-9271-48da-ac95-3998d45e6ccb</uuid>
Nov 16 15:17:13 user nova-compute[74658]:   <name>instance-00000004</name>
Nov 16 15:17:13 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:17:13 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:17:13 user nova-compute[74658]:   <metadata>
Nov 16 15:17:13 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:17:13 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:17:13 user nova-compute[74658]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-228686850</nova:name>
Nov 16 15:17:13 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:17:13</nova:creationTime>
Nov 16 15:17:13 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:17:13 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:17:13 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:17:13 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:17:13 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:17:13 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:17:13 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:17:13 user nova-compute[74658]:       <nova:owner>
Nov 16 15:17:13 user nova-compute[74658]:         <nova:user uuid="01ee1cb04054422e9e93a271b5b3d68f">tempest-ServerStableDeviceRescueTest-509064368-project-member</nova:user>
Nov 16 15:17:13 user nova-compute[74658]:         <nova:project uuid="d59693f6c93045eb86ae04a661060b9c">tempest-ServerStableDeviceRescueTest-509064368</nova:project>
Nov 16 15:17:13 user nova-compute[74658]:       </nova:owner>
Nov 16 15:17:13 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:17:13 user nova-compute[74658]:       <nova:ports>
Nov 16 15:17:13 user nova-compute[74658]:         <nova:port uuid="a370fa54-9887-42af-b8e5-ab80c536cccd">
Nov 16 15:17:13 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 15:17:13 user nova-compute[74658]:         </nova:port>
Nov 16 15:17:13 user nova-compute[74658]:       </nova:ports>
Nov 16 15:17:13 user nova-compute[74658]:     </nova:instance>
Nov 16 15:17:13 user nova-compute[74658]:   </metadata>
Nov 16 15:17:13 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:17:13 user nova-compute[74658]:     <system>
Nov 16 15:17:13 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:17:13 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:17:13 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:17:13 user nova-compute[74658]:       <entry name="serial">e06fcb99-9271-48da-ac95-3998d45e6ccb</entry>
Nov 16 15:17:13 user nova-compute[74658]:       <entry name="uuid">e06fcb99-9271-48da-ac95-3998d45e6ccb</entry>
Nov 16 15:17:13 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:17:13 user nova-compute[74658]:     </system>
Nov 16 15:17:13 user nova-compute[74658]:   </sysinfo>
Nov 16 15:17:13 user nova-compute[74658]:   <os>
Nov 16 15:17:13 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:17:13 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:17:13 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:17:13 user nova-compute[74658]:   </os>
Nov 16 15:17:13 user nova-compute[74658]:   <features>
Nov 16 15:17:13 user nova-compute[74658]:     <acpi/>
Nov 16 15:17:13 user nova-compute[74658]:     <apic/>
Nov 16 15:17:13 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:17:13 user nova-compute[74658]:   </features>
Nov 16 15:17:13 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:17:13 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:17:13 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:17:13 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:17:13 user nova-compute[74658]:   </clock>
Nov 16 15:17:13 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:17:13 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:17:13 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:17:13 user nova-compute[74658]:   </cpu>
Nov 16 15:17:13 user nova-compute[74658]:   <devices>
Nov 16 15:17:13 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:17:13 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:17:13 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk"/>
Nov 16 15:17:13 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:17:13 user nova-compute[74658]:     </disk>
Nov 16 15:17:13 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:17:13 user nova-compute[74658]:       <mac address="fa:16:3e:54:3a:cb"/>
Nov 16 15:17:13 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:13 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:17:13 user nova-compute[74658]:       <target dev="tapa370fa54-98"/>
Nov 16 15:17:13 user nova-compute[74658]:     </interface>
Nov 16 15:17:13 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:17:13 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/console.log" append="off"/>
Nov 16 15:17:13 user nova-compute[74658]:     </serial>
Nov 16 15:17:13 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:17:13 user nova-compute[74658]:     <video>
Nov 16 15:17:13 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:13 user nova-compute[74658]:     </video>
Nov 16 15:17:13 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:17:13 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:17:13 user nova-compute[74658]:     </rng>
Nov 16 15:17:13 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:17:13 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:17:13 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:17:13 user nova-compute[74658]:     </memballoon>
Nov 16 15:17:13 user nova-compute[74658]:   </devices>
Nov 16 15:17:13 user nova-compute[74658]: </domain>
Nov 16 15:17:13 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-228686850',display_name='tempest-ServerStableDeviceRescueTest-server-228686850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-228686850',id=4,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVunN5SWyPcwINY6srB+ewdi3nrsftWq/NkFlvGrCChZ5MlRH6RAFPYwHcXxkfPihChhmEuLuesilMmMMfBAuKVH8FxMhGNYqhemohPM52Id5BtJVMJgwtLbhP/0YxsjA==',key_name='tempest-keypair-1727289241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59693f6c93045eb86ae04a661060b9c',ramdisk_id='',reservation_id='r-t43gbh1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-509064368',owner_user_name='tempest-ServerStableDeviceRescueTest-509064368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ee1cb04054422e9e93a271b5b3d68f',uuid=e06fcb99-9271-48da-ac95-3998d45e6ccb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Converting VIF {"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3a:cb,bridge_name='br-int',has_traffic_filtering=True,id=a370fa54-9887-42af-b8e5-ab80c536cccd,network=Network(a84e7dcd-9cee-4b29-85eb-6eb7441efd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa370fa54-98') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG os_vif [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3a:cb,bridge_name='br-int',has_traffic_filtering=True,id=a370fa54-9887-42af-b8e5-ab80c536cccd,network=Network(a84e7dcd-9cee-4b29-85eb-6eb7441efd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa370fa54-98') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fd1b9f7-208e-5890-8176-3213c8c39265', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa370fa54-98, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa370fa54-98, col_values=(('qos', UUID('a29a6c1f-2c1d-4f19-8a25-cfc9f51d1521')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa370fa54-98, col_values=(('external_ids', {'iface-id': 'a370fa54-9887-42af-b8e5-ab80c536cccd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:3a:cb', 'vm-uuid': 'e06fcb99-9271-48da-ac95-3998d45e6ccb'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:13 user nova-compute[74658]: INFO os_vif [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3a:cb,bridge_name='br-int',has_traffic_filtering=True,id=a370fa54-9887-42af-b8e5-ab80c536cccd,network=Network(a84e7dcd-9cee-4b29-85eb-6eb7441efd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa370fa54-98')
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] No VIF found with MAC fa:16:3e:54:3a:cb, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-4af4e4ea-a272-4271-8d4e-20cdf25c21d3 req-b4aa4677-e71b-4a5d-84f4-f234d22b67c1 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updated VIF entry in instance network info cache for port a370fa54-9887-42af-b8e5-ab80c536cccd. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-4af4e4ea-a272-4271-8d4e-20cdf25c21d3 req-b4aa4677-e71b-4a5d-84f4-f234d22b67c1 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updating instance_info_cache with network_info: [{"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4af4e4ea-a272-4271-8d4e-20cdf25c21d3 req-b4aa4677-e71b-4a5d-84f4-f234d22b67c1 service nova] Releasing lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG nova.network.neutron [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Successfully updated port: 6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquired lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG nova.network.neutron [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-7576d5bd-c7a2-4044-93b8-4f443fcd5dce req-847069fc-3f83-4a60-a1db-532850628a71 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-changed-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-7576d5bd-c7a2-4044-93b8-4f443fcd5dce req-847069fc-3f83-4a60-a1db-532850628a71 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Refreshing instance network info cache due to event network-changed-6abed81e-257d-4d47-a1b8-586c040fdc92. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7576d5bd-c7a2-4044-93b8-4f443fcd5dce req-847069fc-3f83-4a60-a1db-532850628a71 service nova] Acquiring lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG nova.network.neutron [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.network.neutron [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating instance_info_cache with network_info: [{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Releasing lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.compute.manager [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance network_info: |[{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7576d5bd-c7a2-4044-93b8-4f443fcd5dce req-847069fc-3f83-4a60-a1db-532850628a71 service nova] Acquired lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.network.neutron [req-7576d5bd-c7a2-4044-93b8-4f443fcd5dce req-847069fc-3f83-4a60-a1db-532850628a71 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Refreshing network info cache for port 6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Start _get_guest_xml network_info=[{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:17:15 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:15 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1901009930',display_name='tempest-ServerActionsTestOtherB-server-1901009930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1901009930',id=5,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfYsAQlC3nkxAyuTL+KN50dEAunY5gw1KQEIPq+iR4mJ4asJBSmjta4eGNIIDBn+5Mv+AkdxZhEfTWggAEXb2LpORaOL7hjybIPHi4K1ldg1rK7G6KYvZmZ7N35zLKD+g==',key_name='tempest-keypair-983162783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1e465eeac8f4bc5b11c0a6e3a7bbc61',ramdisk_id='',reservation_id='r-gupt4lp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-662756880',owner_user_name='tempest-ServerActionsTestOtherB-662756880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aa837a8e0f14644a3b6b0d3904213f2',uuid=51f00d67-ae3d-4d1b-a721-280bae2e9caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converting VIF {"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.objects.instance [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lazy-loading 'pci_devices' on Instance uuid 51f00d67-ae3d-4d1b-a721-280bae2e9caf {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:17:15 user nova-compute[74658]:   <uuid>51f00d67-ae3d-4d1b-a721-280bae2e9caf</uuid>
Nov 16 15:17:15 user nova-compute[74658]:   <name>instance-00000005</name>
Nov 16 15:17:15 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:17:15 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:17:15 user nova-compute[74658]:   <metadata>
Nov 16 15:17:15 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:17:15 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:17:15 user nova-compute[74658]:       <nova:name>tempest-ServerActionsTestOtherB-server-1901009930</nova:name>
Nov 16 15:17:15 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:17:15</nova:creationTime>
Nov 16 15:17:15 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:17:15 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:17:15 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:17:15 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:17:15 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:17:15 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:17:15 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:17:15 user nova-compute[74658]:       <nova:owner>
Nov 16 15:17:15 user nova-compute[74658]:         <nova:user uuid="9aa837a8e0f14644a3b6b0d3904213f2">tempest-ServerActionsTestOtherB-662756880-project-member</nova:user>
Nov 16 15:17:15 user nova-compute[74658]:         <nova:project uuid="f1e465eeac8f4bc5b11c0a6e3a7bbc61">tempest-ServerActionsTestOtherB-662756880</nova:project>
Nov 16 15:17:15 user nova-compute[74658]:       </nova:owner>
Nov 16 15:17:15 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:17:15 user nova-compute[74658]:       <nova:ports>
Nov 16 15:17:15 user nova-compute[74658]:         <nova:port uuid="6abed81e-257d-4d47-a1b8-586c040fdc92">
Nov 16 15:17:15 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 15:17:15 user nova-compute[74658]:         </nova:port>
Nov 16 15:17:15 user nova-compute[74658]:       </nova:ports>
Nov 16 15:17:15 user nova-compute[74658]:     </nova:instance>
Nov 16 15:17:15 user nova-compute[74658]:   </metadata>
Nov 16 15:17:15 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:17:15 user nova-compute[74658]:     <system>
Nov 16 15:17:15 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:17:15 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:17:15 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:17:15 user nova-compute[74658]:       <entry name="serial">51f00d67-ae3d-4d1b-a721-280bae2e9caf</entry>
Nov 16 15:17:15 user nova-compute[74658]:       <entry name="uuid">51f00d67-ae3d-4d1b-a721-280bae2e9caf</entry>
Nov 16 15:17:15 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:17:15 user nova-compute[74658]:     </system>
Nov 16 15:17:15 user nova-compute[74658]:   </sysinfo>
Nov 16 15:17:15 user nova-compute[74658]:   <os>
Nov 16 15:17:15 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:17:15 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:17:15 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:17:15 user nova-compute[74658]:   </os>
Nov 16 15:17:15 user nova-compute[74658]:   <features>
Nov 16 15:17:15 user nova-compute[74658]:     <acpi/>
Nov 16 15:17:15 user nova-compute[74658]:     <apic/>
Nov 16 15:17:15 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:17:15 user nova-compute[74658]:   </features>
Nov 16 15:17:15 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:17:15 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:17:15 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:17:15 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:17:15 user nova-compute[74658]:   </clock>
Nov 16 15:17:15 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:17:15 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:17:15 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:17:15 user nova-compute[74658]:   </cpu>
Nov 16 15:17:15 user nova-compute[74658]:   <devices>
Nov 16 15:17:15 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:17:15 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:17:15 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk"/>
Nov 16 15:17:15 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:17:15 user nova-compute[74658]:     </disk>
Nov 16 15:17:15 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:17:15 user nova-compute[74658]:       <mac address="fa:16:3e:83:53:58"/>
Nov 16 15:17:15 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:15 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:17:15 user nova-compute[74658]:       <target dev="tap6abed81e-25"/>
Nov 16 15:17:15 user nova-compute[74658]:     </interface>
Nov 16 15:17:15 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:17:15 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/console.log" append="off"/>
Nov 16 15:17:15 user nova-compute[74658]:     </serial>
Nov 16 15:17:15 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:17:15 user nova-compute[74658]:     <video>
Nov 16 15:17:15 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:15 user nova-compute[74658]:     </video>
Nov 16 15:17:15 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:17:15 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:17:15 user nova-compute[74658]:     </rng>
Nov 16 15:17:15 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:17:15 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:17:15 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:17:15 user nova-compute[74658]:     </memballoon>
Nov 16 15:17:15 user nova-compute[74658]:   </devices>
Nov 16 15:17:15 user nova-compute[74658]: </domain>
Nov 16 15:17:15 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1901009930',display_name='tempest-ServerActionsTestOtherB-server-1901009930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1901009930',id=5,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfYsAQlC3nkxAyuTL+KN50dEAunY5gw1KQEIPq+iR4mJ4asJBSmjta4eGNIIDBn+5Mv+AkdxZhEfTWggAEXb2LpORaOL7hjybIPHi4K1ldg1rK7G6KYvZmZ7N35zLKD+g==',key_name='tempest-keypair-983162783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1e465eeac8f4bc5b11c0a6e3a7bbc61',ramdisk_id='',reservation_id='r-gupt4lp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-662756880',owner_user_name='tempest-ServerActionsTestOtherB-662756880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aa837a8e0f14644a3b6b0d3904213f2',uuid=51f00d67-ae3d-4d1b-a721-280bae2e9caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converting VIF {"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG os_vif [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48b27d98-e2cd-5680-87f6-fa2549355058', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6abed81e-25, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6abed81e-25, col_values=(('qos', UUID('6405827c-fd64-444b-97a1-93410df28028')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6abed81e-25, col_values=(('external_ids', {'iface-id': '6abed81e-257d-4d47-a1b8-586c040fdc92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:53:58', 'vm-uuid': '51f00d67-ae3d-4d1b-a721-280bae2e9caf'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:15 user nova-compute[74658]: INFO os_vif [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25')
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:17:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] No VIF found with MAC fa:16:3e:83:53:58, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-7576d5bd-c7a2-4044-93b8-4f443fcd5dce req-847069fc-3f83-4a60-a1db-532850628a71 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updated VIF entry in instance network info cache for port 6abed81e-257d-4d47-a1b8-586c040fdc92. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-7576d5bd-c7a2-4044-93b8-4f443fcd5dce req-847069fc-3f83-4a60-a1db-532850628a71 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating instance_info_cache with network_info: [{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7576d5bd-c7a2-4044-93b8-4f443fcd5dce req-847069fc-3f83-4a60-a1db-532850628a71 service nova] Releasing lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Received event network-vif-plugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] Acquiring lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] No waiting events found dispatching network-vif-plugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:16 user nova-compute[74658]: WARNING nova.compute.manager [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Received unexpected event network-vif-plugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 for instance with vm_state building and task_state spawning.
Nov 16 15:17:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Received event network-vif-plugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] Acquiring lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] No waiting events found dispatching network-vif-plugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:16 user nova-compute[74658]: WARNING nova.compute.manager [req-512d303b-24af-406a-a1e1-0fe3ceb850ec req-2b60ded4-6ad0-4c39-ad74-d90b070b4914 service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Received unexpected event network-vif-plugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 for instance with vm_state building and task_state spawning.
Nov 16 15:17:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-930f3391-388d-4610-9ea6-a543d5f28cfe req-53ccdd40-9dcf-406a-983b-4fade4cfe844 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Received event network-vif-plugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-930f3391-388d-4610-9ea6-a543d5f28cfe req-53ccdd40-9dcf-406a-983b-4fade4cfe844 service nova] Acquiring lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-930f3391-388d-4610-9ea6-a543d5f28cfe req-53ccdd40-9dcf-406a-983b-4fade4cfe844 service nova] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-930f3391-388d-4610-9ea6-a543d5f28cfe req-53ccdd40-9dcf-406a-983b-4fade4cfe844 service nova] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-930f3391-388d-4610-9ea6-a543d5f28cfe req-53ccdd40-9dcf-406a-983b-4fade4cfe844 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] No waiting events found dispatching network-vif-plugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:18 user nova-compute[74658]: WARNING nova.compute.manager [req-930f3391-388d-4610-9ea6-a543d5f28cfe req-53ccdd40-9dcf-406a-983b-4fade4cfe844 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Received unexpected event network-vif-plugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 for instance with vm_state building and task_state spawning.
Nov 16 15:17:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:17:20 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Instance spawned successfully.
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Received event network-vif-plugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] Acquiring lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] No waiting events found dispatching network-vif-plugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:20 user nova-compute[74658]: WARNING nova.compute.manager [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Received unexpected event network-vif-plugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 for instance with vm_state building and task_state spawning.
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:20 user nova-compute[74658]: WARNING nova.compute.manager [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received unexpected event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with vm_state building and task_state spawning.
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:20 user nova-compute[74658]: WARNING nova.compute.manager [req-eb7ca1d9-21f1-4d8a-97ca-fea4cc1f0a5e req-707a09c6-ebfc-45ee-a588-9bc48fe0e4e7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received unexpected event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with vm_state building and task_state spawning.
Nov 16 15:17:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:20 user nova-compute[74658]: INFO nova.compute.manager [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Took 15.11 seconds to spawn the instance on the hypervisor.
Nov 16 15:17:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:17:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:21 user nova-compute[74658]: INFO nova.compute.manager [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Took 15.91 seconds to build instance.
Nov 16 15:17:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-79ec6e1c-3aa9-4e7d-a67a-c82fe158d4cb tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.374s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:17:21 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Instance spawned successfully.
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:17:21 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Instance spawned successfully.
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: INFO nova.compute.manager [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Took 15.89 seconds to spawn the instance on the hypervisor.
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:17:22 user nova-compute[74658]: INFO nova.compute.manager [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Took 18.69 seconds to spawn the instance on the hypervisor.
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:17:22 user nova-compute[74658]: INFO nova.compute.manager [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Took 17.03 seconds to build instance.
Nov 16 15:17:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a53d27a6-c6da-487f-a888-cd071d47475f tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.210s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:17:22 user nova-compute[74658]: INFO nova.compute.manager [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Took 19.71 seconds to build instance.
Nov 16 15:17:22 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Instance spawned successfully.
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:17:22 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance spawned successfully.
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-741b0e7a-fa5c-42b3-9e2c-3f65160e2c81 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.020s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:22 user nova-compute[74658]: INFO nova.compute.manager [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Took 13.95 seconds to spawn the instance on the hypervisor.
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:17:22 user nova-compute[74658]: INFO nova.compute.manager [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Took 17.32 seconds to spawn the instance on the hypervisor.
Nov 16 15:17:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:17:22 user nova-compute[74658]: INFO nova.compute.manager [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Took 14.80 seconds to build instance.
Nov 16 15:17:22 user nova-compute[74658]: INFO nova.compute.manager [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Took 18.25 seconds to build instance.
Nov 16 15:17:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de5ac843-0061-49cd-8784-d4efc9b8210b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.969s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cf9efb88-70af-4266-97e9-3f877c43b07a tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.470s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:17:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:17:30 user nova-compute[74658]: INFO nova.compute.claims [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Claim successful on node user
Nov 16 15:17:30 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:17:30 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:17:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:17:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:17:30 user nova-compute[74658]: DEBUG nova.network.neutron [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:17:31 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 16 15:17:31 user nova-compute[74658]: DEBUG nova.compute.manager [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:17:31 user nova-compute[74658]: DEBUG nova.policy [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52d2f1a679134ca795d13abc1d82ed0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8383a2cd0549d999afd14c6e8f373b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:17:31 user nova-compute[74658]: DEBUG nova.compute.manager [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:17:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:17:31 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Creating image(s)
Nov 16 15:17:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "/opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "/opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "772c045860ed51f4d5b13c3290cbb5bbf59ed046" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "772c045860ed51f4d5b13c3290cbb5bbf59ed046" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046.part --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046.part --force-share --output=json" returned: 0 in 0.308s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:32 user nova-compute[74658]: DEBUG nova.virt.images [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] 18115ea9-3d07-49cf-9980-85c2de757a95 was qcow2, converting to raw {{(pid=74658) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 15:17:32 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:17:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046.part /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046.converted {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046.part /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046.converted" returned: 0 in 0.610s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046.converted --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:32 user nova-compute[74658]: DEBUG nova.network.neutron [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Successfully created port: cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046.converted --force-share --output=json" returned: 0 in 0.337s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "772c045860ed51f4d5b13c3290cbb5bbf59ed046" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.832s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046 --force-share --output=json" returned: 0 in 0.259s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "772c045860ed51f4d5b13c3290cbb5bbf59ed046" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "772c045860ed51f4d5b13c3290cbb5bbf59ed046" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046 --force-share --output=json" returned: 0 in 0.223s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046,backing_fmt=raw /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046,backing_fmt=raw /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk 1073741824" returned: 0 in 0.085s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "772c045860ed51f4d5b13c3290cbb5bbf59ed046" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:33 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:17:33 user nova-compute[74658]: INFO nova.compute.claims [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Claim successful on node user
Nov 16 15:17:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046 --force-share --output=json" returned: 0 in 0.499s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk --force-share --output=json" returned: 0 in 0.432s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Cannot resize image /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Ensure instance console log exists: /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG nova.network.neutron [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Successfully updated port: cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "refresh_cache-ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquired lock "refresh_cache-ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG nova.network.neutron [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG nova.compute.manager [req-f09f40c4-8388-47e7-bb93-bc5e4e5fdb36 req-91aa3a9c-ab8b-44f7-bc77-8048705c1627 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Received event network-changed-cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG nova.compute.manager [req-f09f40c4-8388-47e7-bb93-bc5e4e5fdb36 req-91aa3a9c-ab8b-44f7-bc77-8048705c1627 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Refreshing instance network info cache due to event network-changed-cd4edd24-4702-4a79-af81-025dc029758b. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:17:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f09f40c4-8388-47e7-bb93-bc5e4e5fdb36 req-91aa3a9c-ab8b-44f7-bc77-8048705c1627 service nova] Acquiring lock "refresh_cache-ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.network.neutron [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.419s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:17:35 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.network.neutron [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Updating instance_info_cache with network_info: [{"id": "cd4edd24-4702-4a79-af81-025dc029758b", "address": "fa:16:3e:f1:2a:ca", "network": {"id": "4782d17a-7d24-40e4-8098-22b2ea2b6a31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1120804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8383a2cd0549d999afd14c6e8f373b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4edd24-47", "ovs_interfaceid": "cd4edd24-4702-4a79-af81-025dc029758b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Releasing lock "refresh_cache-ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Instance network_info: |[{"id": "cd4edd24-4702-4a79-af81-025dc029758b", "address": "fa:16:3e:f1:2a:ca", "network": {"id": "4782d17a-7d24-40e4-8098-22b2ea2b6a31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1120804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8383a2cd0549d999afd14c6e8f373b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4edd24-47", "ovs_interfaceid": "cd4edd24-4702-4a79-af81-025dc029758b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f09f40c4-8388-47e7-bb93-bc5e4e5fdb36 req-91aa3a9c-ab8b-44f7-bc77-8048705c1627 service nova] Acquired lock "refresh_cache-ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.network.neutron [req-f09f40c4-8388-47e7-bb93-bc5e4e5fdb36 req-91aa3a9c-ab8b-44f7-bc77-8048705c1627 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Refreshing network info cache for port cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Start _get_guest_xml network_info=[{"id": "cd4edd24-4702-4a79-af81-025dc029758b", "address": "fa:16:3e:f1:2a:ca", "network": {"id": "4782d17a-7d24-40e4-8098-22b2ea2b6a31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1120804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8383a2cd0549d999afd14c6e8f373b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4edd24-47", "ovs_interfaceid": "cd4edd24-4702-4a79-af81-025dc029758b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:17:20Z,direct_url=<?>,disk_format='qcow2',id=18115ea9-3d07-49cf-9980-85c2de757a95,min_disk=0,min_ram=0,name='',owner='f7c19be3339344e38e85a79660ef550c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:17:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'scsi', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': '18115ea9-3d07-49cf-9980-85c2de757a95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:17:35 user nova-compute[74658]: INFO nova.virt.block_device [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Booting with volume c0b36d65-b871-4dbe-88b0-eea4eae50d29 at /dev/vda
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.policy [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '112ea992e8a5439d80ab8032c5f4074d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34629163159f48e5a7e45cc79cd11abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:17:35 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:35 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:17:20Z,direct_url=<?>,disk_format='qcow2',id=18115ea9-3d07-49cf-9980-85c2de757a95,min_disk=0,min_ram=0,name='',owner='f7c19be3339344e38e85a79660ef550c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:17:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-645911138',display_name='tempest-AttachSCSIVolumeTestJSON-server-645911138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-645911138',id=6,image_ref='18115ea9-3d07-49cf-9980-85c2de757a95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAtMFF0sUIBU74bkLIuQqHbB9jEcxzQEh3oSnF10lcr6f+ZpaY4b3FZcjHq2k/obqTXkjUjQ3vBbiqqNVRMO3JvcvrA70/wQyBMyCvoEkI4Ryd8QgFibGZK7F2skn3rHA==',key_name='tempest-keypair-1462490108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c8383a2cd0549d999afd14c6e8f373b',ramdisk_id='',reservation_id='r-l7t8ud7f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18115ea9-3d07-49cf-9980-85c2de757a95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1051769831',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1051769831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d2f1a679134ca795d13abc1d82ed0f',uuid=ce63bd89-0244-4c17-b769-ddbc6ed4b8f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd4edd24-4702-4a79-af81-025dc029758b", "address": "fa:16:3e:f1:2a:ca", "network": {"id": "4782d17a-7d24-40e4-8098-22b2ea2b6a31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1120804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8383a2cd0549d999afd14c6e8f373b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4edd24-47", "ovs_interfaceid": "cd4edd24-4702-4a79-af81-025dc029758b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Converting VIF {"id": "cd4edd24-4702-4a79-af81-025dc029758b", "address": "fa:16:3e:f1:2a:ca", "network": {"id": "4782d17a-7d24-40e4-8098-22b2ea2b6a31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1120804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8383a2cd0549d999afd14c6e8f373b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4edd24-47", "ovs_interfaceid": "cd4edd24-4702-4a79-af81-025dc029758b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:2a:ca,bridge_name='br-int',has_traffic_filtering=True,id=cd4edd24-4702-4a79-af81-025dc029758b,network=Network(4782d17a-7d24-40e4-8098-22b2ea2b6a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4edd24-47') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.objects.instance [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lazy-loading 'pci_devices' on Instance uuid ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:17:35 user nova-compute[74658]:   <uuid>ce63bd89-0244-4c17-b769-ddbc6ed4b8f9</uuid>
Nov 16 15:17:35 user nova-compute[74658]:   <name>instance-00000006</name>
Nov 16 15:17:35 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:17:35 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:17:35 user nova-compute[74658]:   <metadata>
Nov 16 15:17:35 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:17:35 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:17:35 user nova-compute[74658]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-645911138</nova:name>
Nov 16 15:17:35 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:17:35</nova:creationTime>
Nov 16 15:17:35 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:17:35 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:17:35 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:17:35 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:17:35 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:17:35 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:17:35 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:17:35 user nova-compute[74658]:       <nova:owner>
Nov 16 15:17:35 user nova-compute[74658]:         <nova:user uuid="52d2f1a679134ca795d13abc1d82ed0f">tempest-AttachSCSIVolumeTestJSON-1051769831-project-member</nova:user>
Nov 16 15:17:35 user nova-compute[74658]:         <nova:project uuid="3c8383a2cd0549d999afd14c6e8f373b">tempest-AttachSCSIVolumeTestJSON-1051769831</nova:project>
Nov 16 15:17:35 user nova-compute[74658]:       </nova:owner>
Nov 16 15:17:35 user nova-compute[74658]:       <nova:root type="image" uuid="18115ea9-3d07-49cf-9980-85c2de757a95"/>
Nov 16 15:17:35 user nova-compute[74658]:       <nova:ports>
Nov 16 15:17:35 user nova-compute[74658]:         <nova:port uuid="cd4edd24-4702-4a79-af81-025dc029758b">
Nov 16 15:17:35 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 15:17:35 user nova-compute[74658]:         </nova:port>
Nov 16 15:17:35 user nova-compute[74658]:       </nova:ports>
Nov 16 15:17:35 user nova-compute[74658]:     </nova:instance>
Nov 16 15:17:35 user nova-compute[74658]:   </metadata>
Nov 16 15:17:35 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:17:35 user nova-compute[74658]:     <system>
Nov 16 15:17:35 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:17:35 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:17:35 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:17:35 user nova-compute[74658]:       <entry name="serial">ce63bd89-0244-4c17-b769-ddbc6ed4b8f9</entry>
Nov 16 15:17:35 user nova-compute[74658]:       <entry name="uuid">ce63bd89-0244-4c17-b769-ddbc6ed4b8f9</entry>
Nov 16 15:17:35 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:17:35 user nova-compute[74658]:     </system>
Nov 16 15:17:35 user nova-compute[74658]:   </sysinfo>
Nov 16 15:17:35 user nova-compute[74658]:   <os>
Nov 16 15:17:35 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:17:35 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:17:35 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:17:35 user nova-compute[74658]:   </os>
Nov 16 15:17:35 user nova-compute[74658]:   <features>
Nov 16 15:17:35 user nova-compute[74658]:     <acpi/>
Nov 16 15:17:35 user nova-compute[74658]:     <apic/>
Nov 16 15:17:35 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:17:35 user nova-compute[74658]:   </features>
Nov 16 15:17:35 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:17:35 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:17:35 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:17:35 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:17:35 user nova-compute[74658]:   </clock>
Nov 16 15:17:35 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:17:35 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:17:35 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:17:35 user nova-compute[74658]:   </cpu>
Nov 16 15:17:35 user nova-compute[74658]:   <devices>
Nov 16 15:17:35 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:17:35 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:17:35 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk"/>
Nov 16 15:17:35 user nova-compute[74658]:       <target dev="sda" bus="scsi"/>
Nov 16 15:17:35 user nova-compute[74658]:       <address type="drive" controller="0" unit="0"/>
Nov 16 15:17:35 user nova-compute[74658]:     </disk>
Nov 16 15:17:35 user nova-compute[74658]:     <disk type="file" device="cdrom">
Nov 16 15:17:35 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 15:17:35 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk.config"/>
Nov 16 15:17:35 user nova-compute[74658]:       <target dev="sdb" bus="scsi"/>
Nov 16 15:17:35 user nova-compute[74658]:       <address type="drive" controller="0" unit="1"/>
Nov 16 15:17:35 user nova-compute[74658]:     </disk>
Nov 16 15:17:35 user nova-compute[74658]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 16 15:17:35 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:17:35 user nova-compute[74658]:       <mac address="fa:16:3e:f1:2a:ca"/>
Nov 16 15:17:35 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:35 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:17:35 user nova-compute[74658]:       <target dev="tapcd4edd24-47"/>
Nov 16 15:17:35 user nova-compute[74658]:     </interface>
Nov 16 15:17:35 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:17:35 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/console.log" append="off"/>
Nov 16 15:17:35 user nova-compute[74658]:     </serial>
Nov 16 15:17:35 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:17:35 user nova-compute[74658]:     <video>
Nov 16 15:17:35 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:35 user nova-compute[74658]:     </video>
Nov 16 15:17:35 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:17:35 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:17:35 user nova-compute[74658]:     </rng>
Nov 16 15:17:35 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:17:35 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:17:35 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:17:35 user nova-compute[74658]:     </memballoon>
Nov 16 15:17:35 user nova-compute[74658]:   </devices>
Nov 16 15:17:35 user nova-compute[74658]: </domain>
Nov 16 15:17:35 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-645911138',display_name='tempest-AttachSCSIVolumeTestJSON-server-645911138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-645911138',id=6,image_ref='18115ea9-3d07-49cf-9980-85c2de757a95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAtMFF0sUIBU74bkLIuQqHbB9jEcxzQEh3oSnF10lcr6f+ZpaY4b3FZcjHq2k/obqTXkjUjQ3vBbiqqNVRMO3JvcvrA70/wQyBMyCvoEkI4Ryd8QgFibGZK7F2skn3rHA==',key_name='tempest-keypair-1462490108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c8383a2cd0549d999afd14c6e8f373b',ramdisk_id='',reservation_id='r-l7t8ud7f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18115ea9-3d07-49cf-9980-85c2de757a95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1051769831',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1051769831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d2f1a679134ca795d13abc1d82ed0f',uuid=ce63bd89-0244-4c17-b769-ddbc6ed4b8f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd4edd24-4702-4a79-af81-025dc029758b", "address": "fa:16:3e:f1:2a:ca", "network": {"id": "4782d17a-7d24-40e4-8098-22b2ea2b6a31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1120804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8383a2cd0549d999afd14c6e8f373b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4edd24-47", "ovs_interfaceid": "cd4edd24-4702-4a79-af81-025dc029758b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Converting VIF {"id": "cd4edd24-4702-4a79-af81-025dc029758b", "address": "fa:16:3e:f1:2a:ca", "network": {"id": "4782d17a-7d24-40e4-8098-22b2ea2b6a31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1120804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8383a2cd0549d999afd14c6e8f373b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4edd24-47", "ovs_interfaceid": "cd4edd24-4702-4a79-af81-025dc029758b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:2a:ca,bridge_name='br-int',has_traffic_filtering=True,id=cd4edd24-4702-4a79-af81-025dc029758b,network=Network(4782d17a-7d24-40e4-8098-22b2ea2b6a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4edd24-47') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG os_vif [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:2a:ca,bridge_name='br-int',has_traffic_filtering=True,id=cd4edd24-4702-4a79-af81-025dc029758b,network=Network(4782d17a-7d24-40e4-8098-22b2ea2b6a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4edd24-47') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27be14c5-25b4-5ecc-8b1e-50cb327da418', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd4edd24-47, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd4edd24-47, col_values=(('qos', UUID('1a700dae-8617-449c-a92b-8d146fa22e31')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd4edd24-47, col_values=(('external_ids', {'iface-id': 'cd4edd24-4702-4a79-af81-025dc029758b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:2a:ca', 'vm-uuid': 'ce63bd89-0244-4c17-b769-ddbc6ed4b8f9'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:35 user nova-compute[74658]: INFO os_vif [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:2a:ca,bridge_name='br-int',has_traffic_filtering=True,id=cd4edd24-4702-4a79-af81-025dc029758b,network=Network(4782d17a-7d24-40e4-8098-22b2ea2b6a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4edd24-47')
Nov 16 15:17:35 user nova-compute[74658]: DEBUG os_brick.utils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:17:35 user nova-compute[74658]: INFO oslo.privsep.daemon [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpt74e3mt8/privsep.sock']
Nov 16 15:17:35 user sudo[84808]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpt74e3mt8/privsep.sock
Nov 16 15:17:35 user sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 15:17:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:36 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] No BDM found with device name sda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:17:36 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:17:36 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] No VIF found with MAC fa:16:3e:f1:2a:ca, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:17:36 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Using config drive
Nov 16 15:17:36 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:17:36 user nova-compute[74658]: DEBUG nova.network.neutron [req-f09f40c4-8388-47e7-bb93-bc5e4e5fdb36 req-91aa3a9c-ab8b-44f7-bc77-8048705c1627 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Updated VIF entry in instance network info cache for port cd4edd24-4702-4a79-af81-025dc029758b. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:17:36 user nova-compute[74658]: DEBUG nova.network.neutron [req-f09f40c4-8388-47e7-bb93-bc5e4e5fdb36 req-91aa3a9c-ab8b-44f7-bc77-8048705c1627 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Updating instance_info_cache with network_info: [{"id": "cd4edd24-4702-4a79-af81-025dc029758b", "address": "fa:16:3e:f1:2a:ca", "network": {"id": "4782d17a-7d24-40e4-8098-22b2ea2b6a31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1120804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8383a2cd0549d999afd14c6e8f373b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4edd24-47", "ovs_interfaceid": "cd4edd24-4702-4a79-af81-025dc029758b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f09f40c4-8388-47e7-bb93-bc5e4e5fdb36 req-91aa3a9c-ab8b-44f7-bc77-8048705c1627 service nova] Releasing lock "refresh_cache-ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:36 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:17:36 user nova-compute[74658]: INFO nova.compute.claims [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Claim successful on node user
Nov 16 15:17:36 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:17:36 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:17:37 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Creating config drive at /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk.config
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp85c6re0i {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp85c6re0i" returned: 0 in 0.106s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:37 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:17:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Successfully created port: 64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG nova.policy [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7029a0cbbc9444018c91ef577408605a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1b74d765ef4353b10308124094030f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:17:37 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Creating image(s)
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "/opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "/opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "/opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:37 user sudo[84808]: pam_unix(sudo:session): session closed for user root
Nov 16 15:17:37 user nova-compute[74658]: INFO oslo.privsep.daemon [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Spawned new privsep daemon via rootwrap
Nov 16 15:17:37 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 15:17:37 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 15:17:37 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 16 15:17:37 user nova-compute[74658]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84815
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.255s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[96627513-249a-4df1-ac96-141b0982afa1]: (2,) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.208s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG nova.compute.manager [req-442fb607-4d31-4388-aebc-ef73ee467bf1 req-ce3014e7-bced-4cae-9c08-56544cfe872f service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-442fb607-4d31-4388-aebc-ef73ee467bf1 req-ce3014e7-bced-4cae-9c08-56544cfe872f service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-442fb607-4d31-4388-aebc-ef73ee467bf1 req-ce3014e7-bced-4cae-9c08-56544cfe872f service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-442fb607-4d31-4388-aebc-ef73ee467bf1 req-ce3014e7-bced-4cae-9c08-56544cfe872f service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG nova.compute.manager [req-442fb607-4d31-4388-aebc-ef73ee467bf1 req-ce3014e7-bced-4cae-9c08-56544cfe872f service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:38 user nova-compute[74658]: WARNING nova.compute.manager [req-442fb607-4d31-4388-aebc-ef73ee467bf1 req-ce3014e7-bced-4cae-9c08-56544cfe872f service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received unexpected event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with vm_state active and task_state None.
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk 1073741824" returned: 0 in 0.122s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.047s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf622b44-5be2-4f3e-8c38-f951be1a6758]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:38 user nova-compute[74658]: WARNING os_brick.initiator.connectors.nvmeof [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.225s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.119s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fee9be-8b66-4f21-b6cc-93ad34b8a4c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.046s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63115ea-c27c-40cd-99d1-ba50a2b03a5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7712eb-6b7e-4fe0-8d85-6a24951ce3a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Cannot resize image /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Ensure instance console log exists: /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:17:38 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:17:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff10b4c5-e4c1-4375-b85b-fa14d9368f94]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG os_brick.utils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] <== get_connector_properties: return (2794ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Updating existing volume attachment record: 805d3906-5f52-4004-817f-a5c6ede38f81 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG nova.network.neutron [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Successfully created port: 1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Acquiring lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Successfully updated port: 64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "refresh_cache-d497d108-2eb4-448d-9d1f-e8864e0b48a4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquired lock "refresh_cache-d497d108-2eb4-448d-9d1f-e8864e0b48a4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:39 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:17:39 user nova-compute[74658]: INFO nova.compute.claims [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Claim successful on node user
Nov 16 15:17:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG nova.compute.manager [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG nova.compute.manager [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:40 user nova-compute[74658]: WARNING nova.compute.manager [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received unexpected event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with vm_state active and task_state None.
Nov 16 15:17:40 user nova-compute[74658]: DEBUG nova.compute.manager [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-changed-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG nova.compute.manager [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Refreshing instance network info cache due to event network-changed-64c01998-6dfe-48d7-8e96-baf6a9cce100. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] Acquiring lock "refresh_cache-d497d108-2eb4-448d-9d1f-e8864e0b48a4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Updating instance_info_cache with network_info: [{"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Releasing lock "refresh_cache-d497d108-2eb4-448d-9d1f-e8864e0b48a4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Instance network_info: |[{"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] Acquired lock "refresh_cache-d497d108-2eb4-448d-9d1f-e8864e0b48a4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG nova.network.neutron [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Refreshing network info cache for port 64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.984s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:40 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:17:41 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:17:41 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:17:41 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:17:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:41 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:17:41 user nova-compute[74658]: INFO nova.compute.claims [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Claim successful on node user
Nov 16 15:17:41 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:17:41 user nova-compute[74658]: DEBUG nova.policy [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbde6e05279e4dd5b7d854bbab2c1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178e7561b73544a284db0720f88a0fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.neutron [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Updated VIF entry in instance network info cache for port 64c01998-6dfe-48d7-8e96-baf6a9cce100. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.neutron [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Updating instance_info_cache with network_info: [{"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:17:42 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Creating image(s)
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "/opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "/opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.neutron [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Successfully updated port: 1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-20f75df4-d602-46e1-9fa1-b3120b82f750 req-3582dd52-b760-46a4-ab54-d2ec8fd349b2 service nova] Releasing lock "refresh_cache-d497d108-2eb4-448d-9d1f-e8864e0b48a4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "refresh_cache-11bd9639-1c9e-4080-bd89-bf34724684d5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquired lock "refresh_cache-11bd9639-1c9e-4080-bd89-bf34724684d5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.neutron [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.226s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.neutron [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-98248c4b-25eb-4c29-9568-634a562d7477 req-4249a7c6-7d24-46d0-9fa0-2052b768d943 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Received event network-changed-1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-98248c4b-25eb-4c29-9568-634a562d7477 req-4249a7c6-7d24-46d0-9fa0-2052b768d943 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Refreshing instance network info cache due to event network-changed-1772b72e-f08e-4494-8023-b54d65490e21. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-98248c4b-25eb-4c29-9568-634a562d7477 req-4249a7c6-7d24-46d0-9fa0-2052b768d943 service nova] Acquiring lock "refresh_cache-11bd9639-1c9e-4080-bd89-bf34724684d5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.352s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.286s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk 1073741824" returned: 0 in 0.111s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-86804824-0b77-4acb-b959-4502fd09db37 req-b0482d76-29cc-4bd5-9746-18d86579287f service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received event network-vif-plugged-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-86804824-0b77-4acb-b959-4502fd09db37 req-b0482d76-29cc-4bd5-9746-18d86579287f service nova] Acquiring lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-86804824-0b77-4acb-b959-4502fd09db37 req-b0482d76-29cc-4bd5-9746-18d86579287f service nova] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-86804824-0b77-4acb-b959-4502fd09db37 req-b0482d76-29cc-4bd5-9746-18d86579287f service nova] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-86804824-0b77-4acb-b959-4502fd09db37 req-b0482d76-29cc-4bd5-9746-18d86579287f service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] No waiting events found dispatching network-vif-plugged-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:42 user nova-compute[74658]: WARNING nova.compute.manager [req-86804824-0b77-4acb-b959-4502fd09db37 req-b0482d76-29cc-4bd5-9746-18d86579287f service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received unexpected event network-vif-plugged-4999888f-3310-45f7-bc33-8180b8110ef9 for instance with vm_state active and task_state None.
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.420s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Successfully created port: 2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:42 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.neutron [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Updating instance_info_cache with network_info: [{"id": "1772b72e-f08e-4494-8023-b54d65490e21", "address": "fa:16:3e:c9:8d:a0", "network": {"id": "10b7ee2b-413e-4661-a24c-632afd5beae1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1561286324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f1b74d765ef4353b10308124094030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772b72e-f0", "ovs_interfaceid": "1772b72e-f08e-4494-8023-b54d65490e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:17:42 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Instance spawned successfully.
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Releasing lock "refresh_cache-11bd9639-1c9e-4080-bd89-bf34724684d5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Instance network_info: |[{"id": "1772b72e-f08e-4494-8023-b54d65490e21", "address": "fa:16:3e:c9:8d:a0", "network": {"id": "10b7ee2b-413e-4661-a24c-632afd5beae1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1561286324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f1b74d765ef4353b10308124094030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772b72e-f0", "ovs_interfaceid": "1772b72e-f08e-4494-8023-b54d65490e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-98248c4b-25eb-4c29-9568-634a562d7477 req-4249a7c6-7d24-46d0-9fa0-2052b768d943 service nova] Acquired lock "refresh_cache-11bd9639-1c9e-4080-bd89-bf34724684d5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.neutron [req-98248c4b-25eb-4c29-9568-634a562d7477 req-4249a7c6-7d24-46d0-9fa0-2052b768d943 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Refreshing network info cache for port 1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Start _get_guest_xml network_info=[{"id": "1772b72e-f08e-4494-8023-b54d65490e21", "address": "fa:16:3e:c9:8d:a0", "network": {"id": "10b7ee2b-413e-4661-a24c-632afd5beae1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1561286324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f1b74d765ef4353b10308124094030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772b72e-f0", "ovs_interfaceid": "1772b72e-f08e-4494-8023-b54d65490e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:42 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:42 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2050760709',display_name='tempest-TestVolumeSwap-server-2050760709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2050760709',id=8,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpusj1BiFnUMN1OBt657lhe/ktnhwL+RHoDydZ7IALfTffJm//qB9BLq1nXrgji0G6SNJTVsCt6gxeQk28dmlylh/GpMiHp4Fpr0tYayGJHkUAWT8YVQ/NF8zJyONPClw==',key_name='tempest-keypair-1377503364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f1b74d765ef4353b10308124094030f',ramdisk_id='',reservation_id='r-keemv6rb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-404220467',owner_user_name='tempest-TestVolumeSwap-404220467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029a0cbbc9444018c91ef577408605a',uuid=11bd9639-1c9e-4080-bd89-bf34724684d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1772b72e-f08e-4494-8023-b54d65490e21", "address": "fa:16:3e:c9:8d:a0", "network": {"id": "10b7ee2b-413e-4661-a24c-632afd5beae1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1561286324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f1b74d765ef4353b10308124094030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772b72e-f0", "ovs_interfaceid": "1772b72e-f08e-4494-8023-b54d65490e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Converting VIF {"id": "1772b72e-f08e-4494-8023-b54d65490e21", "address": "fa:16:3e:c9:8d:a0", "network": {"id": "10b7ee2b-413e-4661-a24c-632afd5beae1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1561286324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f1b74d765ef4353b10308124094030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772b72e-f0", "ovs_interfaceid": "1772b72e-f08e-4494-8023-b54d65490e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8d:a0,bridge_name='br-int',has_traffic_filtering=True,id=1772b72e-f08e-4494-8023-b54d65490e21,network=Network(10b7ee2b-413e-4661-a24c-632afd5beae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772b72e-f0') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lazy-loading 'pci_devices' on Instance uuid 11bd9639-1c9e-4080-bd89-bf34724684d5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:17:42 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Creating image(s)
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "/opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "/opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "/opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:17:42 user nova-compute[74658]:   <uuid>11bd9639-1c9e-4080-bd89-bf34724684d5</uuid>
Nov 16 15:17:42 user nova-compute[74658]:   <name>instance-00000008</name>
Nov 16 15:17:42 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:17:42 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:17:42 user nova-compute[74658]:   <metadata>
Nov 16 15:17:42 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:17:42 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:17:42 user nova-compute[74658]:       <nova:name>tempest-TestVolumeSwap-server-2050760709</nova:name>
Nov 16 15:17:42 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:17:42</nova:creationTime>
Nov 16 15:17:42 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:17:42 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:17:42 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:17:42 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:17:42 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:17:42 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:17:42 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:17:42 user nova-compute[74658]:       <nova:owner>
Nov 16 15:17:42 user nova-compute[74658]:         <nova:user uuid="7029a0cbbc9444018c91ef577408605a">tempest-TestVolumeSwap-404220467-project-member</nova:user>
Nov 16 15:17:42 user nova-compute[74658]:         <nova:project uuid="0f1b74d765ef4353b10308124094030f">tempest-TestVolumeSwap-404220467</nova:project>
Nov 16 15:17:42 user nova-compute[74658]:       </nova:owner>
Nov 16 15:17:42 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:17:42 user nova-compute[74658]:       <nova:ports>
Nov 16 15:17:42 user nova-compute[74658]:         <nova:port uuid="1772b72e-f08e-4494-8023-b54d65490e21">
Nov 16 15:17:42 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 15:17:42 user nova-compute[74658]:         </nova:port>
Nov 16 15:17:42 user nova-compute[74658]:       </nova:ports>
Nov 16 15:17:42 user nova-compute[74658]:     </nova:instance>
Nov 16 15:17:42 user nova-compute[74658]:   </metadata>
Nov 16 15:17:42 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:17:42 user nova-compute[74658]:     <system>
Nov 16 15:17:42 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:17:42 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:17:42 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:17:42 user nova-compute[74658]:       <entry name="serial">11bd9639-1c9e-4080-bd89-bf34724684d5</entry>
Nov 16 15:17:42 user nova-compute[74658]:       <entry name="uuid">11bd9639-1c9e-4080-bd89-bf34724684d5</entry>
Nov 16 15:17:42 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:17:42 user nova-compute[74658]:     </system>
Nov 16 15:17:42 user nova-compute[74658]:   </sysinfo>
Nov 16 15:17:42 user nova-compute[74658]:   <os>
Nov 16 15:17:42 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:17:42 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:17:42 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:17:42 user nova-compute[74658]:   </os>
Nov 16 15:17:42 user nova-compute[74658]:   <features>
Nov 16 15:17:42 user nova-compute[74658]:     <acpi/>
Nov 16 15:17:42 user nova-compute[74658]:     <apic/>
Nov 16 15:17:42 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:17:42 user nova-compute[74658]:   </features>
Nov 16 15:17:42 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:17:42 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:17:42 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:17:42 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:17:42 user nova-compute[74658]:   </clock>
Nov 16 15:17:42 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:17:42 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:17:42 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:17:42 user nova-compute[74658]:   </cpu>
Nov 16 15:17:42 user nova-compute[74658]:   <devices>
Nov 16 15:17:42 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:17:42 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:17:42 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk"/>
Nov 16 15:17:42 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:17:42 user nova-compute[74658]:     </disk>
Nov 16 15:17:42 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:17:42 user nova-compute[74658]:       <mac address="fa:16:3e:c9:8d:a0"/>
Nov 16 15:17:42 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:42 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:17:42 user nova-compute[74658]:       <target dev="tap1772b72e-f0"/>
Nov 16 15:17:42 user nova-compute[74658]:     </interface>
Nov 16 15:17:42 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:17:42 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/console.log" append="off"/>
Nov 16 15:17:42 user nova-compute[74658]:     </serial>
Nov 16 15:17:42 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:17:42 user nova-compute[74658]:     <video>
Nov 16 15:17:42 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:42 user nova-compute[74658]:     </video>
Nov 16 15:17:42 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:17:42 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:17:42 user nova-compute[74658]:     </rng>
Nov 16 15:17:42 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:17:42 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:17:42 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:17:42 user nova-compute[74658]:     </memballoon>
Nov 16 15:17:42 user nova-compute[74658]:   </devices>
Nov 16 15:17:42 user nova-compute[74658]: </domain>
Nov 16 15:17:42 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2050760709',display_name='tempest-TestVolumeSwap-server-2050760709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2050760709',id=8,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpusj1BiFnUMN1OBt657lhe/ktnhwL+RHoDydZ7IALfTffJm//qB9BLq1nXrgji0G6SNJTVsCt6gxeQk28dmlylh/GpMiHp4Fpr0tYayGJHkUAWT8YVQ/NF8zJyONPClw==',key_name='tempest-keypair-1377503364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f1b74d765ef4353b10308124094030f',ramdisk_id='',reservation_id='r-keemv6rb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-404220467',owner_user_name='tempest-TestVolumeSwap-404220467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029a0cbbc9444018c91ef577408605a',uuid=11bd9639-1c9e-4080-bd89-bf34724684d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1772b72e-f08e-4494-8023-b54d65490e21", "address": "fa:16:3e:c9:8d:a0", "network": {"id": "10b7ee2b-413e-4661-a24c-632afd5beae1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1561286324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f1b74d765ef4353b10308124094030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772b72e-f0", "ovs_interfaceid": "1772b72e-f08e-4494-8023-b54d65490e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Converting VIF {"id": "1772b72e-f08e-4494-8023-b54d65490e21", "address": "fa:16:3e:c9:8d:a0", "network": {"id": "10b7ee2b-413e-4661-a24c-632afd5beae1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1561286324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f1b74d765ef4353b10308124094030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772b72e-f0", "ovs_interfaceid": "1772b72e-f08e-4494-8023-b54d65490e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8d:a0,bridge_name='br-int',has_traffic_filtering=True,id=1772b72e-f08e-4494-8023-b54d65490e21,network=Network(10b7ee2b-413e-4661-a24c-632afd5beae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772b72e-f0') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG os_vif [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8d:a0,bridge_name='br-int',has_traffic_filtering=True,id=1772b72e-f08e-4494-8023-b54d65490e21,network=Network(10b7ee2b-413e-4661-a24c-632afd5beae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772b72e-f0') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:17:42 user nova-compute[74658]: DEBUG nova.policy [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3ae2183da41421f88946b3cea996833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19164c5a777949f790615128d2ee350c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:17:43 user nova-compute[74658]: INFO nova.compute.manager [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Took 11.71 seconds to spawn the instance on the hypervisor.
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.compute.manager [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1c7dd0f-dd87-524e-9775-a042ab256d71', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.332s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1772b72e-f0, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1772b72e-f0, col_values=(('qos', UUID('2f6773f4-3ff6-424f-8b76-c165047c1680')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1772b72e-f0, col_values=(('external_ids', {'iface-id': '1772b72e-f08e-4494-8023-b54d65490e21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:8d:a0', 'vm-uuid': '11bd9639-1c9e-4080-bd89-bf34724684d5'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:43 user nova-compute[74658]: INFO os_vif [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8d:a0,bridge_name='br-int',has_traffic_filtering=True,id=1772b72e-f08e-4494-8023-b54d65490e21,network=Network(10b7ee2b-413e-4661-a24c-632afd5beae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772b72e-f0')
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.191s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:43 user nova-compute[74658]: INFO nova.compute.manager [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Took 13.02 seconds to build instance.
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-df2bcce6-afbe-4ee2-ade7-8c0e2452568b tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.348s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Cannot resize image /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Ensure instance console log exists: /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] No VIF found with MAC fa:16:3e:c9:8d:a0, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.219s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk 1073741824" returned: 0 in 0.066s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Successfully updated port: 2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Acquiring lock "refresh_cache-a2f77c43-8afd-465a-bb09-537cc3c6461d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Acquired lock "refresh_cache-a2f77c43-8afd-465a-bb09-537cc3c6461d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-589398d8-3355-49c7-ac63-e99b4b20f959 req-5e88f253-9ef0-4571-8820-664f83926ab7 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Received event network-changed-2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-589398d8-3355-49c7-ac63-e99b4b20f959 req-5e88f253-9ef0-4571-8820-664f83926ab7 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Refreshing instance network info cache due to event network-changed-2f8f9aea-261c-4e66-a187-93378644d1eb. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-589398d8-3355-49c7-ac63-e99b4b20f959 req-5e88f253-9ef0-4571-8820-664f83926ab7 service nova] Acquiring lock "refresh_cache-a2f77c43-8afd-465a-bb09-537cc3c6461d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.203s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Cannot resize image /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Ensure instance console log exists: /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:43 user nova-compute[74658]: DEBUG nova.network.neutron [req-98248c4b-25eb-4c29-9568-634a562d7477 req-4249a7c6-7d24-46d0-9fa0-2052b768d943 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Updated VIF entry in instance network info cache for port 1772b72e-f08e-4494-8023-b54d65490e21. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.network.neutron [req-98248c4b-25eb-4c29-9568-634a562d7477 req-4249a7c6-7d24-46d0-9fa0-2052b768d943 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Updating instance_info_cache with network_info: [{"id": "1772b72e-f08e-4494-8023-b54d65490e21", "address": "fa:16:3e:c9:8d:a0", "network": {"id": "10b7ee2b-413e-4661-a24c-632afd5beae1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1561286324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f1b74d765ef4353b10308124094030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772b72e-f0", "ovs_interfaceid": "1772b72e-f08e-4494-8023-b54d65490e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-98248c4b-25eb-4c29-9568-634a562d7477 req-4249a7c6-7d24-46d0-9fa0-2052b768d943 service nova] Releasing lock "refresh_cache-11bd9639-1c9e-4080-bd89-bf34724684d5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Updating instance_info_cache with network_info: [{"id": "2f8f9aea-261c-4e66-a187-93378644d1eb", "address": "fa:16:3e:0e:8b:db", "network": {"id": "c4338e19-e8b4-4395-8709-98a16689c81e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688938605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "178e7561b73544a284db0720f88a0fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8f9aea-26", "ovs_interfaceid": "2f8f9aea-261c-4e66-a187-93378644d1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Releasing lock "refresh_cache-a2f77c43-8afd-465a-bb09-537cc3c6461d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Instance network_info: |[{"id": "2f8f9aea-261c-4e66-a187-93378644d1eb", "address": "fa:16:3e:0e:8b:db", "network": {"id": "c4338e19-e8b4-4395-8709-98a16689c81e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688938605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "178e7561b73544a284db0720f88a0fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8f9aea-26", "ovs_interfaceid": "2f8f9aea-261c-4e66-a187-93378644d1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-589398d8-3355-49c7-ac63-e99b4b20f959 req-5e88f253-9ef0-4571-8820-664f83926ab7 service nova] Acquired lock "refresh_cache-a2f77c43-8afd-465a-bb09-537cc3c6461d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.network.neutron [req-589398d8-3355-49c7-ac63-e99b4b20f959 req-5e88f253-9ef0-4571-8820-664f83926ab7 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Refreshing network info cache for port 2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Start _get_guest_xml network_info=[{"id": "2f8f9aea-261c-4e66-a187-93378644d1eb", "address": "fa:16:3e:0e:8b:db", "network": {"id": "c4338e19-e8b4-4395-8709-98a16689c81e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688938605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "178e7561b73544a284db0720f88a0fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8f9aea-26", "ovs_interfaceid": "2f8f9aea-261c-4e66-a187-93378644d1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:17:44 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:44 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1723290884',display_name='tempest-VolumesAssistedSnapshotsTest-server-1723290884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1723290884',id=9,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZXL7ifukTlpXpqn0smbXZ2XqRTlW0z/I/At2rpOsKzWHZpzoaYNzKeWgtQBpz+3h7r89goVsFMSWRbPxIyLOKs9aq0rULiXLbeBQszwKQWS3R0wCdyTU8CZSmkAbAiSA==',key_name='tempest-keypair-45209290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='178e7561b73544a284db0720f88a0fb6',ramdisk_id='',reservation_id='r-fq10my64',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1418335071',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1418335071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbde6e05279e4dd5b7d854bbab2c1e50',uuid=a2f77c43-8afd-465a-bb09-537cc3c6461d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f8f9aea-261c-4e66-a187-93378644d1eb", "address": "fa:16:3e:0e:8b:db", "network": {"id": "c4338e19-e8b4-4395-8709-98a16689c81e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688938605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "178e7561b73544a284db0720f88a0fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8f9aea-26", "ovs_interfaceid": "2f8f9aea-261c-4e66-a187-93378644d1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Converting VIF {"id": "2f8f9aea-261c-4e66-a187-93378644d1eb", "address": "fa:16:3e:0e:8b:db", "network": {"id": "c4338e19-e8b4-4395-8709-98a16689c81e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688938605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "178e7561b73544a284db0720f88a0fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8f9aea-26", "ovs_interfaceid": "2f8f9aea-261c-4e66-a187-93378644d1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:8b:db,bridge_name='br-int',has_traffic_filtering=True,id=2f8f9aea-261c-4e66-a187-93378644d1eb,network=Network(c4338e19-e8b4-4395-8709-98a16689c81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8f9aea-26') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lazy-loading 'pci_devices' on Instance uuid a2f77c43-8afd-465a-bb09-537cc3c6461d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:17:44 user nova-compute[74658]:   <uuid>a2f77c43-8afd-465a-bb09-537cc3c6461d</uuid>
Nov 16 15:17:44 user nova-compute[74658]:   <name>instance-00000009</name>
Nov 16 15:17:44 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:17:44 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:17:44 user nova-compute[74658]:   <metadata>
Nov 16 15:17:44 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:17:44 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:17:44 user nova-compute[74658]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1723290884</nova:name>
Nov 16 15:17:44 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:17:44</nova:creationTime>
Nov 16 15:17:44 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:17:44 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:17:44 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:17:44 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:17:44 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:17:44 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:17:44 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:17:44 user nova-compute[74658]:       <nova:owner>
Nov 16 15:17:44 user nova-compute[74658]:         <nova:user uuid="dbde6e05279e4dd5b7d854bbab2c1e50">tempest-VolumesAssistedSnapshotsTest-1418335071-project-member</nova:user>
Nov 16 15:17:44 user nova-compute[74658]:         <nova:project uuid="178e7561b73544a284db0720f88a0fb6">tempest-VolumesAssistedSnapshotsTest-1418335071</nova:project>
Nov 16 15:17:44 user nova-compute[74658]:       </nova:owner>
Nov 16 15:17:44 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:17:44 user nova-compute[74658]:       <nova:ports>
Nov 16 15:17:44 user nova-compute[74658]:         <nova:port uuid="2f8f9aea-261c-4e66-a187-93378644d1eb">
Nov 16 15:17:44 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 15:17:44 user nova-compute[74658]:         </nova:port>
Nov 16 15:17:44 user nova-compute[74658]:       </nova:ports>
Nov 16 15:17:44 user nova-compute[74658]:     </nova:instance>
Nov 16 15:17:44 user nova-compute[74658]:   </metadata>
Nov 16 15:17:44 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:17:44 user nova-compute[74658]:     <system>
Nov 16 15:17:44 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:17:44 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:17:44 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:17:44 user nova-compute[74658]:       <entry name="serial">a2f77c43-8afd-465a-bb09-537cc3c6461d</entry>
Nov 16 15:17:44 user nova-compute[74658]:       <entry name="uuid">a2f77c43-8afd-465a-bb09-537cc3c6461d</entry>
Nov 16 15:17:44 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:17:44 user nova-compute[74658]:     </system>
Nov 16 15:17:44 user nova-compute[74658]:   </sysinfo>
Nov 16 15:17:44 user nova-compute[74658]:   <os>
Nov 16 15:17:44 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:17:44 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:17:44 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:17:44 user nova-compute[74658]:   </os>
Nov 16 15:17:44 user nova-compute[74658]:   <features>
Nov 16 15:17:44 user nova-compute[74658]:     <acpi/>
Nov 16 15:17:44 user nova-compute[74658]:     <apic/>
Nov 16 15:17:44 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:17:44 user nova-compute[74658]:   </features>
Nov 16 15:17:44 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:17:44 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:17:44 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:17:44 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:17:44 user nova-compute[74658]:   </clock>
Nov 16 15:17:44 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:17:44 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:17:44 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:17:44 user nova-compute[74658]:   </cpu>
Nov 16 15:17:44 user nova-compute[74658]:   <devices>
Nov 16 15:17:44 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:17:44 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:17:44 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk"/>
Nov 16 15:17:44 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:17:44 user nova-compute[74658]:     </disk>
Nov 16 15:17:44 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:17:44 user nova-compute[74658]:       <mac address="fa:16:3e:0e:8b:db"/>
Nov 16 15:17:44 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:44 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:17:44 user nova-compute[74658]:       <target dev="tap2f8f9aea-26"/>
Nov 16 15:17:44 user nova-compute[74658]:     </interface>
Nov 16 15:17:44 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:17:44 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/console.log" append="off"/>
Nov 16 15:17:44 user nova-compute[74658]:     </serial>
Nov 16 15:17:44 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:17:44 user nova-compute[74658]:     <video>
Nov 16 15:17:44 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:44 user nova-compute[74658]:     </video>
Nov 16 15:17:44 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:17:44 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:17:44 user nova-compute[74658]:     </rng>
Nov 16 15:17:44 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:17:44 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:17:44 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:17:44 user nova-compute[74658]:     </memballoon>
Nov 16 15:17:44 user nova-compute[74658]:   </devices>
Nov 16 15:17:44 user nova-compute[74658]: </domain>
Nov 16 15:17:44 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1723290884',display_name='tempest-VolumesAssistedSnapshotsTest-server-1723290884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1723290884',id=9,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZXL7ifukTlpXpqn0smbXZ2XqRTlW0z/I/At2rpOsKzWHZpzoaYNzKeWgtQBpz+3h7r89goVsFMSWRbPxIyLOKs9aq0rULiXLbeBQszwKQWS3R0wCdyTU8CZSmkAbAiSA==',key_name='tempest-keypair-45209290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='178e7561b73544a284db0720f88a0fb6',ramdisk_id='',reservation_id='r-fq10my64',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1418335071',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1418335071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbde6e05279e4dd5b7d854bbab2c1e50',uuid=a2f77c43-8afd-465a-bb09-537cc3c6461d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f8f9aea-261c-4e66-a187-93378644d1eb", "address": "fa:16:3e:0e:8b:db", "network": {"id": "c4338e19-e8b4-4395-8709-98a16689c81e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688938605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "178e7561b73544a284db0720f88a0fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8f9aea-26", "ovs_interfaceid": "2f8f9aea-261c-4e66-a187-93378644d1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Converting VIF {"id": "2f8f9aea-261c-4e66-a187-93378644d1eb", "address": "fa:16:3e:0e:8b:db", "network": {"id": "c4338e19-e8b4-4395-8709-98a16689c81e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688938605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "178e7561b73544a284db0720f88a0fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8f9aea-26", "ovs_interfaceid": "2f8f9aea-261c-4e66-a187-93378644d1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:8b:db,bridge_name='br-int',has_traffic_filtering=True,id=2f8f9aea-261c-4e66-a187-93378644d1eb,network=Network(c4338e19-e8b4-4395-8709-98a16689c81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8f9aea-26') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG os_vif [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:8b:db,bridge_name='br-int',has_traffic_filtering=True,id=2f8f9aea-261c-4e66-a187-93378644d1eb,network=Network(c4338e19-e8b4-4395-8709-98a16689c81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8f9aea-26') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec266dc0-7522-5a14-a849-771676560d2d', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f8f9aea-26, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f8f9aea-26, col_values=(('qos', UUID('fcd13afb-43ff-41c0-9a0e-adf58bed25fe')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f8f9aea-26, col_values=(('external_ids', {'iface-id': '2f8f9aea-261c-4e66-a187-93378644d1eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:8b:db', 'vm-uuid': 'a2f77c43-8afd-465a-bb09-537cc3c6461d'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: INFO os_vif [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:8b:db,bridge_name='br-int',has_traffic_filtering=True,id=2f8f9aea-261c-4e66-a187-93378644d1eb,network=Network(c4338e19-e8b4-4395-8709-98a16689c81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8f9aea-26')
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Successfully created port: 555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] No VIF found with MAC fa:16:3e:0e:8b:db, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-4d52529d-53f8-4c47-b8f1-ea1c8a92a2ae req-aaafc423-9630-445f-a187-e8ef8494de95 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received event network-vif-plugged-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4d52529d-53f8-4c47-b8f1-ea1c8a92a2ae req-aaafc423-9630-445f-a187-e8ef8494de95 service nova] Acquiring lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4d52529d-53f8-4c47-b8f1-ea1c8a92a2ae req-aaafc423-9630-445f-a187-e8ef8494de95 service nova] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4d52529d-53f8-4c47-b8f1-ea1c8a92a2ae req-aaafc423-9630-445f-a187-e8ef8494de95 service nova] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-4d52529d-53f8-4c47-b8f1-ea1c8a92a2ae req-aaafc423-9630-445f-a187-e8ef8494de95 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] No waiting events found dispatching network-vif-plugged-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:44 user nova-compute[74658]: WARNING nova.compute.manager [req-4d52529d-53f8-4c47-b8f1-ea1c8a92a2ae req-aaafc423-9630-445f-a187-e8ef8494de95 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received unexpected event network-vif-plugged-4999888f-3310-45f7-bc33-8180b8110ef9 for instance with vm_state active and task_state None.
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.network.neutron [req-589398d8-3355-49c7-ac63-e99b4b20f959 req-5e88f253-9ef0-4571-8820-664f83926ab7 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Updated VIF entry in instance network info cache for port 2f8f9aea-261c-4e66-a187-93378644d1eb. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.network.neutron [req-589398d8-3355-49c7-ac63-e99b4b20f959 req-5e88f253-9ef0-4571-8820-664f83926ab7 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Updating instance_info_cache with network_info: [{"id": "2f8f9aea-261c-4e66-a187-93378644d1eb", "address": "fa:16:3e:0e:8b:db", "network": {"id": "c4338e19-e8b4-4395-8709-98a16689c81e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688938605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "178e7561b73544a284db0720f88a0fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8f9aea-26", "ovs_interfaceid": "2f8f9aea-261c-4e66-a187-93378644d1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-589398d8-3355-49c7-ac63-e99b4b20f959 req-5e88f253-9ef0-4571-8820-664f83926ab7 service nova] Releasing lock "refresh_cache-a2f77c43-8afd-465a-bb09-537cc3c6461d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:17:44 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Creating image(s)
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Ensure instance console log exists: /opt/stack/data/nova/instances/d497d108-2eb4-448d-9d1f-e8864e0b48a4/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Start _get_guest_xml network_info=[{"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '805d3906-5f52-4004-817f-a5c6ede38f81', 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRGUKVeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd497d108-2eb4-448d-9d1f-e8864e0b48a4', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0b36d65-b871-4dbe-88b0-eea4eae50d29', 'serial': 'c0b36d65-b871-4dbe-88b0-eea4eae50d29'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:17:45 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:45 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connector [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Factory for ISCSI on None {{(pid=74658) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.140s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRGUKVeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:17:45 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:17:45 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:17:45 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[54534cf9-2800-4afa-91c0-a2c30ba15e69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:17:45 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a622d0-9ee2-46c0-9da6-bd8d3f16909c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29] added
Nov 16 15:17:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Successfully updated port: 555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "refresh_cache-16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquired lock "refresh_cache-16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad3bd1c-3d09-4374-a5d5-6ce68f62362e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-3992ae6e-aa31-4964-b683-bf392a106d18 req-8c31d29d-e48f-444e-9f0d-5ff5647a6ea5 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Received event network-changed-555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-3992ae6e-aa31-4964-b683-bf392a106d18 req-8c31d29d-e48f-444e-9f0d-5ff5647a6ea5 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Refreshing instance network info cache due to event network-changed-555621d9-35a8-43e8-9f3c-6c829a7fcdbe. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3992ae6e-aa31-4964-b683-bf392a106d18 req-8c31d29d-e48f-444e-9f0d-5ff5647a6ea5 service nova] Acquiring lock "refresh_cache-16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb30acc-7065-4a8b-9379-04515559cd96]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRGUKVeB {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRGUKVeB" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ab56cc-d8b5-4fcf-b083-a54f4c9780fd]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NRGUKVeB'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09456c5-6dfd-4bee-8ea7-230b0d33d213]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[71143a5c-3fdc-4a8e-b1f8-2140daa14e28]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:17:45 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:17:45 user nova-compute[74658]:  {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:17:45 user nova-compute[74658]: WARNING os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 15:17:45 user nova-compute[74658]: 
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c826c4b-b788-425d-a2b6-0407c40d7d3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260]
Nov 16 15:17:45 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260] successful.
Nov 16 15:17:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7833fb-9420-47cf-8a69-52621574bb26]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4f0ab4-0371-4fab-9914-af28df782441]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:17:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:17:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f72d2a7-44fe-418b-b95b-325c62bf8bfb]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRGUKVeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-6e3917b8-432c-4397-88bd-3c15c872bd8c req-96300d13-46fb-4161-b4ec-80bdc45f9dd6 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Received event network-vif-plugged-1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6e3917b8-432c-4397-88bd-3c15c872bd8c req-96300d13-46fb-4161-b4ec-80bdc45f9dd6 service nova] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6e3917b8-432c-4397-88bd-3c15c872bd8c req-96300d13-46fb-4161-b4ec-80bdc45f9dd6 service nova] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6e3917b8-432c-4397-88bd-3c15c872bd8c req-96300d13-46fb-4161-b4ec-80bdc45f9dd6 service nova] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-6e3917b8-432c-4397-88bd-3c15c872bd8c req-96300d13-46fb-4161-b4ec-80bdc45f9dd6 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] No waiting events found dispatching network-vif-plugged-1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:45 user nova-compute[74658]: WARNING nova.compute.manager [req-6e3917b8-432c-4397-88bd-3c15c872bd8c req-96300d13-46fb-4161-b4ec-80bdc45f9dd6 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Received unexpected event network-vif-plugged-1772b72e-f08e-4494-8023-b54d65490e21 for instance with vm_state building and task_state spawning.
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Updating instance_info_cache with network_info: [{"id": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "address": "fa:16:3e:fc:a7:b2", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555621d9-35", "ovs_interfaceid": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Releasing lock "refresh_cache-16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Instance network_info: |[{"id": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "address": "fa:16:3e:fc:a7:b2", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555621d9-35", "ovs_interfaceid": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3992ae6e-aa31-4964-b683-bf392a106d18 req-8c31d29d-e48f-444e-9f0d-5ff5647a6ea5 service nova] Acquired lock "refresh_cache-16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.network.neutron [req-3992ae6e-aa31-4964-b683-bf392a106d18 req-8c31d29d-e48f-444e-9f0d-5ff5647a6ea5 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Refreshing network info cache for port 555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Start _get_guest_xml network_info=[{"id": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "address": "fa:16:3e:fc:a7:b2", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555621d9-35", "ovs_interfaceid": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:17:46 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:46 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-642206347',display_name='tempest-VolumesSnapshotTestJSON-instance-642206347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-642206347',id=10,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYtfd9s0fNVyQHkl9Sjw1hBoS7nT/Cw9QiKoWIlbKhpmYCwAcM3asJn/PtYtMdX4nwh3WovaFAayHlCU254SdfDIfspOMCFJ+IxWNBZ8vbf6cwwuWjIFViJN0DWp9JNbA==',key_name='tempest-keypair-111195385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19164c5a777949f790615128d2ee350c',ramdisk_id='',reservation_id='r-ordgda0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1886586727',owner_user_name='tempest-VolumesSnapshotTestJSON-1886586727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3ae2183da41421f88946b3cea996833',uuid=16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "address": "fa:16:3e:fc:a7:b2", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555621d9-35", "ovs_interfaceid": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converting VIF {"id": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "address": "fa:16:3e:fc:a7:b2", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555621d9-35", "ovs_interfaceid": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a7:b2,bridge_name='br-int',has_traffic_filtering=True,id=555621d9-35a8-43e8-9f3c-6c829a7fcdbe,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555621d9-35') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.objects.instance [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lazy-loading 'pci_devices' on Instance uuid 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:17:46 user nova-compute[74658]:   <uuid>16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f</uuid>
Nov 16 15:17:46 user nova-compute[74658]:   <name>instance-0000000a</name>
Nov 16 15:17:46 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:17:46 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:17:46 user nova-compute[74658]:   <metadata>
Nov 16 15:17:46 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:17:46 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:17:46 user nova-compute[74658]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-642206347</nova:name>
Nov 16 15:17:46 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:17:46</nova:creationTime>
Nov 16 15:17:46 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:17:46 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:17:46 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:17:46 user nova-compute[74658]:       <nova:owner>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:user uuid="e3ae2183da41421f88946b3cea996833">tempest-VolumesSnapshotTestJSON-1886586727-project-member</nova:user>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:project uuid="19164c5a777949f790615128d2ee350c">tempest-VolumesSnapshotTestJSON-1886586727</nova:project>
Nov 16 15:17:46 user nova-compute[74658]:       </nova:owner>
Nov 16 15:17:46 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:17:46 user nova-compute[74658]:       <nova:ports>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:port uuid="555621d9-35a8-43e8-9f3c-6c829a7fcdbe">
Nov 16 15:17:46 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 15:17:46 user nova-compute[74658]:         </nova:port>
Nov 16 15:17:46 user nova-compute[74658]:       </nova:ports>
Nov 16 15:17:46 user nova-compute[74658]:     </nova:instance>
Nov 16 15:17:46 user nova-compute[74658]:   </metadata>
Nov 16 15:17:46 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:17:46 user nova-compute[74658]:     <system>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="serial">16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f</entry>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="uuid">16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f</entry>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:17:46 user nova-compute[74658]:     </system>
Nov 16 15:17:46 user nova-compute[74658]:   </sysinfo>
Nov 16 15:17:46 user nova-compute[74658]:   <os>
Nov 16 15:17:46 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:17:46 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:17:46 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:17:46 user nova-compute[74658]:   </os>
Nov 16 15:17:46 user nova-compute[74658]:   <features>
Nov 16 15:17:46 user nova-compute[74658]:     <acpi/>
Nov 16 15:17:46 user nova-compute[74658]:     <apic/>
Nov 16 15:17:46 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:17:46 user nova-compute[74658]:   </features>
Nov 16 15:17:46 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:17:46 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:17:46 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:17:46 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:17:46 user nova-compute[74658]:   </clock>
Nov 16 15:17:46 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:17:46 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:17:46 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:17:46 user nova-compute[74658]:   </cpu>
Nov 16 15:17:46 user nova-compute[74658]:   <devices>
Nov 16 15:17:46 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:17:46 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:17:46 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk"/>
Nov 16 15:17:46 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:17:46 user nova-compute[74658]:     </disk>
Nov 16 15:17:46 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:17:46 user nova-compute[74658]:       <mac address="fa:16:3e:fc:a7:b2"/>
Nov 16 15:17:46 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:46 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:17:46 user nova-compute[74658]:       <target dev="tap555621d9-35"/>
Nov 16 15:17:46 user nova-compute[74658]:     </interface>
Nov 16 15:17:46 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:17:46 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/console.log" append="off"/>
Nov 16 15:17:46 user nova-compute[74658]:     </serial>
Nov 16 15:17:46 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:17:46 user nova-compute[74658]:     <video>
Nov 16 15:17:46 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:46 user nova-compute[74658]:     </video>
Nov 16 15:17:46 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:17:46 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:17:46 user nova-compute[74658]:     </rng>
Nov 16 15:17:46 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:17:46 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:17:46 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:17:46 user nova-compute[74658]:     </memballoon>
Nov 16 15:17:46 user nova-compute[74658]:   </devices>
Nov 16 15:17:46 user nova-compute[74658]: </domain>
Nov 16 15:17:46 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-642206347',display_name='tempest-VolumesSnapshotTestJSON-instance-642206347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-642206347',id=10,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYtfd9s0fNVyQHkl9Sjw1hBoS7nT/Cw9QiKoWIlbKhpmYCwAcM3asJn/PtYtMdX4nwh3WovaFAayHlCU254SdfDIfspOMCFJ+IxWNBZ8vbf6cwwuWjIFViJN0DWp9JNbA==',key_name='tempest-keypair-111195385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19164c5a777949f790615128d2ee350c',ramdisk_id='',reservation_id='r-ordgda0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1886586727',owner_user_name='tempest-VolumesSnapshotTestJSON-1886586727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3ae2183da41421f88946b3cea996833',uuid=16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "address": "fa:16:3e:fc:a7:b2", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555621d9-35", "ovs_interfaceid": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converting VIF {"id": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "address": "fa:16:3e:fc:a7:b2", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555621d9-35", "ovs_interfaceid": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a7:b2,bridge_name='br-int',has_traffic_filtering=True,id=555621d9-35a8-43e8-9f3c-6c829a7fcdbe,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555621d9-35') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG os_vif [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a7:b2,bridge_name='br-int',has_traffic_filtering=True,id=555621d9-35a8-43e8-9f3c-6c829a7fcdbe,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555621d9-35') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c802139-70bd-5724-9556-c1be3785d0ec', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap555621d9-35, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap555621d9-35, col_values=(('qos', UUID('5b15a339-9d59-41e2-b5a2-f6043ee4d392')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap555621d9-35, col_values=(('external_ids', {'iface-id': '555621d9-35a8-43e8-9f3c-6c829a7fcdbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:a7:b2', 'vm-uuid': '16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: INFO os_vif [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a7:b2,bridge_name='br-int',has_traffic_filtering=True,id=555621d9-35a8-43e8-9f3c-6c829a7fcdbe,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555621d9-35')
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] No VIF found with MAC fa:16:3e:fc:a7:b2, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23366333934363537', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366333934363537', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-950433439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-950433439',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkap0gRNcurWDfCcy7qt804/okYphbvtBgQJOzKxESAFGAYHBwlIXmSq28wC/by2fh2JpmwGxBO4odLx6IdBKSumHSyV2ncRWbtbwWfg4j7iPSMFgyo5c1IQ1GaeCy8NQ==',key_name='tempest-keypair-790246539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34629163159f48e5a7e45cc79cd11abb',ramdisk_id='',reservation_id='r-rlllv1i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-912489320',owner_user_name='tempest-ServerActionsV293TestJSON-912489320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='112ea992e8a5439d80ab8032c5f4074d',uuid=d497d108-2eb4-448d-9d1f-e8864e0b48a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converting VIF {"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.objects.instance [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lazy-loading 'pci_devices' on Instance uuid d497d108-2eb4-448d-9d1f-e8864e0b48a4 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:17:46 user nova-compute[74658]:   <uuid>d497d108-2eb4-448d-9d1f-e8864e0b48a4</uuid>
Nov 16 15:17:46 user nova-compute[74658]:   <name>instance-00000007</name>
Nov 16 15:17:46 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:17:46 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:17:46 user nova-compute[74658]:   <metadata>
Nov 16 15:17:46 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:17:46 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:17:46 user nova-compute[74658]:       <nova:name>tempest-ServerActionsV293TestJSON-server-950433439</nova:name>
Nov 16 15:17:46 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:17:45</nova:creationTime>
Nov 16 15:17:46 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:17:46 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:17:46 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:17:46 user nova-compute[74658]:       <nova:owner>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:user uuid="112ea992e8a5439d80ab8032c5f4074d">tempest-ServerActionsV293TestJSON-912489320-project-member</nova:user>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:project uuid="34629163159f48e5a7e45cc79cd11abb">tempest-ServerActionsV293TestJSON-912489320</nova:project>
Nov 16 15:17:46 user nova-compute[74658]:       </nova:owner>
Nov 16 15:17:46 user nova-compute[74658]:       <nova:ports>
Nov 16 15:17:46 user nova-compute[74658]:         <nova:port uuid="64c01998-6dfe-48d7-8e96-baf6a9cce100">
Nov 16 15:17:46 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 15:17:46 user nova-compute[74658]:         </nova:port>
Nov 16 15:17:46 user nova-compute[74658]:       </nova:ports>
Nov 16 15:17:46 user nova-compute[74658]:     </nova:instance>
Nov 16 15:17:46 user nova-compute[74658]:   </metadata>
Nov 16 15:17:46 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:17:46 user nova-compute[74658]:     <system>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="serial">d497d108-2eb4-448d-9d1f-e8864e0b48a4</entry>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="uuid">d497d108-2eb4-448d-9d1f-e8864e0b48a4</entry>
Nov 16 15:17:46 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:17:46 user nova-compute[74658]:     </system>
Nov 16 15:17:46 user nova-compute[74658]:   </sysinfo>
Nov 16 15:17:46 user nova-compute[74658]:   <os>
Nov 16 15:17:46 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:17:46 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:17:46 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:17:46 user nova-compute[74658]:   </os>
Nov 16 15:17:46 user nova-compute[74658]:   <features>
Nov 16 15:17:46 user nova-compute[74658]:     <acpi/>
Nov 16 15:17:46 user nova-compute[74658]:     <apic/>
Nov 16 15:17:46 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:17:46 user nova-compute[74658]:   </features>
Nov 16 15:17:46 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:17:46 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:17:46 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:17:46 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:17:46 user nova-compute[74658]:   </clock>
Nov 16 15:17:46 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:17:46 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:17:46 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:17:46 user nova-compute[74658]:   </cpu>
Nov 16 15:17:46 user nova-compute[74658]:   <devices>
Nov 16 15:17:46 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:17:46 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:17:46 user nova-compute[74658]:       <source dev="/dev/sdb"/>
Nov 16 15:17:46 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:17:46 user nova-compute[74658]:       <serial>c0b36d65-b871-4dbe-88b0-eea4eae50d29</serial>
Nov 16 15:17:46 user nova-compute[74658]:     </disk>
Nov 16 15:17:46 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:17:46 user nova-compute[74658]:       <mac address="fa:16:3e:e3:63:a2"/>
Nov 16 15:17:46 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:46 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:17:46 user nova-compute[74658]:       <target dev="tap64c01998-6d"/>
Nov 16 15:17:46 user nova-compute[74658]:     </interface>
Nov 16 15:17:46 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:17:46 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/d497d108-2eb4-448d-9d1f-e8864e0b48a4/console.log" append="off"/>
Nov 16 15:17:46 user nova-compute[74658]:     </serial>
Nov 16 15:17:46 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:17:46 user nova-compute[74658]:     <video>
Nov 16 15:17:46 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:17:46 user nova-compute[74658]:     </video>
Nov 16 15:17:46 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:17:46 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:17:46 user nova-compute[74658]:     </rng>
Nov 16 15:17:46 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:17:46 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:17:46 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:17:46 user nova-compute[74658]:     </memballoon>
Nov 16 15:17:46 user nova-compute[74658]:   </devices>
Nov 16 15:17:46 user nova-compute[74658]: </domain>
Nov 16 15:17:46 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-950433439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-950433439',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkap0gRNcurWDfCcy7qt804/okYphbvtBgQJOzKxESAFGAYHBwlIXmSq28wC/by2fh2JpmwGxBO4odLx6IdBKSumHSyV2ncRWbtbwWfg4j7iPSMFgyo5c1IQ1GaeCy8NQ==',key_name='tempest-keypair-790246539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34629163159f48e5a7e45cc79cd11abb',ramdisk_id='',reservation_id='r-rlllv1i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-912489320',owner_user_name='tempest-ServerActionsV293TestJSON-912489320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='112ea992e8a5439d80ab8032c5f4074d',uuid=d497d108-2eb4-448d-9d1f-e8864e0b48a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converting VIF {"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG os_vif [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'effac83f-b733-584e-ab6d-24a8949c46a0', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64c01998-6d, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64c01998-6d, col_values=(('qos', UUID('a4a3d64a-7188-4f10-8109-6095a29bf8c0')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64c01998-6d, col_values=(('external_ids', {'iface-id': '64c01998-6dfe-48d7-8e96-baf6a9cce100', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:63:a2', 'vm-uuid': 'd497d108-2eb4-448d-9d1f-e8864e0b48a4'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:46 user nova-compute[74658]: INFO os_vif [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d')
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:17:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] No VIF found with MAC fa:16:3e:e3:63:a2, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:17:47 user nova-compute[74658]: DEBUG nova.network.neutron [req-3992ae6e-aa31-4964-b683-bf392a106d18 req-8c31d29d-e48f-444e-9f0d-5ff5647a6ea5 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Updated VIF entry in instance network info cache for port 555621d9-35a8-43e8-9f3c-6c829a7fcdbe. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:17:47 user nova-compute[74658]: DEBUG nova.network.neutron [req-3992ae6e-aa31-4964-b683-bf392a106d18 req-8c31d29d-e48f-444e-9f0d-5ff5647a6ea5 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Updating instance_info_cache with network_info: [{"id": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "address": "fa:16:3e:fc:a7:b2", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555621d9-35", "ovs_interfaceid": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:17:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3992ae6e-aa31-4964-b683-bf392a106d18 req-8c31d29d-e48f-444e-9f0d-5ff5647a6ea5 service nova] Releasing lock "refresh_cache-16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:17:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-544124ec-c4b9-49cf-8792-7beb2ff652f1 req-f55c273f-0f51-4b2b-99e6-9e15a13a9d4b service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Received event network-vif-plugged-1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-544124ec-c4b9-49cf-8792-7beb2ff652f1 req-f55c273f-0f51-4b2b-99e6-9e15a13a9d4b service nova] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-544124ec-c4b9-49cf-8792-7beb2ff652f1 req-f55c273f-0f51-4b2b-99e6-9e15a13a9d4b service nova] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-544124ec-c4b9-49cf-8792-7beb2ff652f1 req-f55c273f-0f51-4b2b-99e6-9e15a13a9d4b service nova] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-544124ec-c4b9-49cf-8792-7beb2ff652f1 req-f55c273f-0f51-4b2b-99e6-9e15a13a9d4b service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] No waiting events found dispatching network-vif-plugged-1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:47 user nova-compute[74658]: WARNING nova.compute.manager [req-544124ec-c4b9-49cf-8792-7beb2ff652f1 req-f55c273f-0f51-4b2b-99e6-9e15a13a9d4b service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Received unexpected event network-vif-plugged-1772b72e-f08e-4494-8023-b54d65490e21 for instance with vm_state building and task_state spawning.
Nov 16 15:17:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-d0842bc2-846c-45bf-93db-92d15520aad0 req-dc28a506-3f92-477b-80d4-e5d388782eb7 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Received event network-vif-plugged-2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d0842bc2-846c-45bf-93db-92d15520aad0 req-dc28a506-3f92-477b-80d4-e5d388782eb7 service nova] Acquiring lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d0842bc2-846c-45bf-93db-92d15520aad0 req-dc28a506-3f92-477b-80d4-e5d388782eb7 service nova] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d0842bc2-846c-45bf-93db-92d15520aad0 req-dc28a506-3f92-477b-80d4-e5d388782eb7 service nova] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-d0842bc2-846c-45bf-93db-92d15520aad0 req-dc28a506-3f92-477b-80d4-e5d388782eb7 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] No waiting events found dispatching network-vif-plugged-2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:49 user nova-compute[74658]: WARNING nova.compute.manager [req-d0842bc2-846c-45bf-93db-92d15520aad0 req-dc28a506-3f92-477b-80d4-e5d388782eb7 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Received unexpected event network-vif-plugged-2f8f9aea-261c-4e66-a187-93378644d1eb for instance with vm_state building and task_state spawning.
Nov 16 15:17:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-e342f596-58da-451f-a010-c504832af8d7 req-a8b62cab-8341-43a2-ae3b-5f4c08613d48 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e342f596-58da-451f-a010-c504832af8d7 req-a8b62cab-8341-43a2-ae3b-5f4c08613d48 service nova] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e342f596-58da-451f-a010-c504832af8d7 req-a8b62cab-8341-43a2-ae3b-5f4c08613d48 service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e342f596-58da-451f-a010-c504832af8d7 req-a8b62cab-8341-43a2-ae3b-5f4c08613d48 service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-e342f596-58da-451f-a010-c504832af8d7 req-a8b62cab-8341-43a2-ae3b-5f4c08613d48 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] No waiting events found dispatching network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:51 user nova-compute[74658]: WARNING nova.compute.manager [req-e342f596-58da-451f-a010-c504832af8d7 req-a8b62cab-8341-43a2-ae3b-5f4c08613d48 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received unexpected event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 for instance with vm_state building and task_state spawning.
Nov 16 15:17:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-1962512a-d926-477e-9509-63a01a3fcdcb req-27eb7784-e5cb-4047-8f27-4d3ad07d9938 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Received event network-vif-plugged-2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1962512a-d926-477e-9509-63a01a3fcdcb req-27eb7784-e5cb-4047-8f27-4d3ad07d9938 service nova] Acquiring lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1962512a-d926-477e-9509-63a01a3fcdcb req-27eb7784-e5cb-4047-8f27-4d3ad07d9938 service nova] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1962512a-d926-477e-9509-63a01a3fcdcb req-27eb7784-e5cb-4047-8f27-4d3ad07d9938 service nova] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-1962512a-d926-477e-9509-63a01a3fcdcb req-27eb7784-e5cb-4047-8f27-4d3ad07d9938 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] No waiting events found dispatching network-vif-plugged-2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:51 user nova-compute[74658]: WARNING nova.compute.manager [req-1962512a-d926-477e-9509-63a01a3fcdcb req-27eb7784-e5cb-4047-8f27-4d3ad07d9938 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Received unexpected event network-vif-plugged-2f8f9aea-261c-4e66-a187-93378644d1eb for instance with vm_state building and task_state spawning.
Nov 16 15:17:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:51 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Instance spawned successfully.
Nov 16 15:17:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:17:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:52 user nova-compute[74658]: INFO nova.compute.manager [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Took 14.58 seconds to spawn the instance on the hypervisor.
Nov 16 15:17:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:17:52 user nova-compute[74658]: INFO nova.compute.manager [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Took 16.11 seconds to build instance.
Nov 16 15:17:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:17:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ef5e504b-c42e-4539-b5cd-9e74f1451646 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.327s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:17:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Instance spawned successfully.
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: INFO nova.compute.manager [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Took 11.18 seconds to spawn the instance on the hypervisor.
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:17:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Instance spawned successfully.
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:17:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Instance spawned successfully.
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-6e1c0357-62d6-43b3-8825-470fde8b810e req-e228fe17-e096-4345-82c5-246912641092 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6e1c0357-62d6-43b3-8825-470fde8b810e req-e228fe17-e096-4345-82c5-246912641092 service nova] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6e1c0357-62d6-43b3-8825-470fde8b810e req-e228fe17-e096-4345-82c5-246912641092 service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6e1c0357-62d6-43b3-8825-470fde8b810e req-e228fe17-e096-4345-82c5-246912641092 service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-6e1c0357-62d6-43b3-8825-470fde8b810e req-e228fe17-e096-4345-82c5-246912641092 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] No waiting events found dispatching network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:17:53 user nova-compute[74658]: WARNING nova.compute.manager [req-6e1c0357-62d6-43b3-8825-470fde8b810e req-e228fe17-e096-4345-82c5-246912641092 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received unexpected event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 for instance with vm_state building and task_state spawning.
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:17:53 user nova-compute[74658]: INFO nova.compute.manager [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Took 13.56 seconds to build instance.
Nov 16 15:17:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0fb7428e-30a1-4e01-abc1-3276602719f1 tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.808s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:53 user nova-compute[74658]: INFO nova.compute.manager [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Took 10.62 seconds to spawn the instance on the hypervisor.
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:17:53 user nova-compute[74658]: INFO nova.compute.manager [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Took 8.56 seconds to spawn the instance on the hypervisor.
Nov 16 15:17:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:17:53 user nova-compute[74658]: INFO nova.compute.manager [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Took 12.61 seconds to build instance.
Nov 16 15:17:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3db20884-3e73-4330-9fb1-6abf8aa1c2af tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.807s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:53 user nova-compute[74658]: INFO nova.compute.manager [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Took 19.99 seconds to build instance.
Nov 16 15:17:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f41e84e1-e3e4-46c5-a9d2-c5c61d53ed96 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.199s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:17:54 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:17:55 user nova-compute[74658]: INFO nova.compute.claims [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Claim successful on node user
Nov 16 15:17:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.766s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:17:55 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:17:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:56 user nova-compute[74658]: INFO nova.virt.block_device [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Booting with volume 6670f484-f45a-40d3-985f-2f4da8490ef4 at /dev/vda
Nov 16 15:17:56 user nova-compute[74658]: DEBUG nova.policy [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cecb346ee3a94c90aedb89436ad41db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099c984ee9724b058a8611c5482cdc10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG os_brick.utils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff76d3f4-ed5f-4fca-be8b-68e256f29c2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02c31d9-bf51-4d8d-b75e-8b2e4999ef9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f4b51b-6ed2-4301-9f94-a605db09442f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93f41cd-f18d-4d6c-b269-5d917dc375d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:17:56 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cf57ca-e80e-4f4c-a6fa-971e7e767094]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG os_brick.utils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] <== get_connector_properties: return (318ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating existing volume attachment record: 0d16c569-0e9f-49df-9c55-7ca70ba211af {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:57 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully created port: bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:57 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully created port: 2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:58 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully created port: 34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.334s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:58 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully created port: 7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:17:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:17:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:17:59 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully created port: 5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:17:59 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:59 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:17:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7730MB free_disk=25.753055572509766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:17:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:17:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 03cbebbf-5414-4309-bfc1-ec0a67e09a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e06fcb99-9271-48da-ac95-3998d45e6ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 51f00d67-ae3d-4d1b-a721-280bae2e9caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance d497d108-2eb4-448d-9d1f-e8864e0b48a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 11bd9639-1c9e-4080-bd89-bf34724684d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance a2f77c43-8afd-465a-bb09-537cc3c6461d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully updated port: bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-673ae046-0545-419d-89bb-e3a0a2292384 req-08c83ade-5f4b-460e-815c-79c670f0fc9a service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-changed-bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-673ae046-0545-419d-89bb-e3a0a2292384 req-08c83ade-5f4b-460e-815c-79c670f0fc9a service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing instance network info cache due to event network-changed-bdddb146-3305-47a7-a523-d6430b3d2ced. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-673ae046-0545-419d-89bb-e3a0a2292384 req-08c83ade-5f4b-460e-815c-79c670f0fc9a service nova] Acquiring lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-673ae046-0545-419d-89bb-e3a0a2292384 req-08c83ade-5f4b-460e-815c-79c670f0fc9a service nova] Acquired lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.network.neutron [req-673ae046-0545-419d-89bb-e3a0a2292384 req-08c83ade-5f4b-460e-815c-79c670f0fc9a service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing network info cache for port bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.network.neutron [req-673ae046-0545-419d-89bb-e3a0a2292384 req-08c83ade-5f4b-460e-815c-79c670f0fc9a service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:18:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.106s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-673ae046-0545-419d-89bb-e3a0a2292384 req-08c83ade-5f4b-460e-815c-79c670f0fc9a service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-673ae046-0545-419d-89bb-e3a0a2292384 req-08c83ade-5f4b-460e-815c-79c670f0fc9a service nova] Releasing lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully updated port: a187a46b-1664-43a5-986e-c6abadee65c6 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-364c38db-f345-439d-8b86-e92d69946d6a req-cc27f173-5caf-4b8e-bb78-8a00e468d705 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Received event network-vif-plugged-cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-364c38db-f345-439d-8b86-e92d69946d6a req-cc27f173-5caf-4b8e-bb78-8a00e468d705 service nova] Acquiring lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-364c38db-f345-439d-8b86-e92d69946d6a req-cc27f173-5caf-4b8e-bb78-8a00e468d705 service nova] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-364c38db-f345-439d-8b86-e92d69946d6a req-cc27f173-5caf-4b8e-bb78-8a00e468d705 service nova] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-364c38db-f345-439d-8b86-e92d69946d6a req-cc27f173-5caf-4b8e-bb78-8a00e468d705 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] No waiting events found dispatching network-vif-plugged-cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:01 user nova-compute[74658]: WARNING nova.compute.manager [req-364c38db-f345-439d-8b86-e92d69946d6a req-cc27f173-5caf-4b8e-bb78-8a00e468d705 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Received unexpected event network-vif-plugged-cd4edd24-4702-4a79-af81-025dc029758b for instance with vm_state active and task_state None.
Nov 16 15:18:01 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:18:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully updated port: a61ce95b-32ea-48c9-b694-df72d417424d {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Skipping network cache update for instance because it is Building. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 7ef751d1-099a-4b46-b08d-99929d449ef9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updating instance_info_cache with network_info: [{"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-changed-a187a46b-1664-43a5-986e-c6abadee65c6 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing instance network info cache due to event network-changed-a187a46b-1664-43a5-986e-c6abadee65c6. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] Acquiring lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] Acquired lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.network.neutron [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing network info cache for port a187a46b-1664-43a5-986e-c6abadee65c6 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully updated port: 2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.network.neutron [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-6fe7b325-8d2f-474e-93ba-3c9bca13fdfd req-bec6298b-dba4-44c8-8fad-4ae9b69fd6d8 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-changed-2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-6fe7b325-8d2f-474e-93ba-3c9bca13fdfd req-bec6298b-dba4-44c8-8fad-4ae9b69fd6d8 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing instance network info cache due to event network-changed-2547184e-c859-4452-9e1d-da23edc28844. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:18:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6fe7b325-8d2f-474e-93ba-3c9bca13fdfd req-bec6298b-dba4-44c8-8fad-4ae9b69fd6d8 service nova] Acquiring lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] Releasing lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-changed-a61ce95b-32ea-48c9-b694-df72d417424d {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing instance network info cache due to event network-changed-a61ce95b-32ea-48c9-b694-df72d417424d. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] Acquiring lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] Acquired lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing network info cache for port a61ce95b-32ea-48c9-b694-df72d417424d {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:18:03 user nova-compute[74658]: INFO nova.virt.block_device [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Booting with volume 44367556-dcc5-4738-ac00-f8a6c678e3b0 at /dev/vdb
Nov 16 15:18:03 user nova-compute[74658]: DEBUG os_brick.utils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[42424865-4ad4-4cbe-82b4-957593d3f1de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-30fa774e-03c3-4629-b80b-00db9a8585cc req-95070b7b-e20d-463e-83fc-6e9950fd2fa1 service nova] Releasing lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6fe7b325-8d2f-474e-93ba-3c9bca13fdfd req-bec6298b-dba4-44c8-8fad-4ae9b69fd6d8 service nova] Acquired lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-6fe7b325-8d2f-474e-93ba-3c9bca13fdfd req-bec6298b-dba4-44c8-8fad-4ae9b69fd6d8 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing network info cache for port 2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[114d6566-1d98-4ff0-af11-28a8b75cc4dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3330a1a-4fe3-4e66-9caa-8524e30f62ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f69732-1c57-4b87-a500-770f2faee094]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully updated port: 34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-6fe7b325-8d2f-474e-93ba-3c9bca13fdfd req-bec6298b-dba4-44c8-8fad-4ae9b69fd6d8 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:18:03 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1144eaae-5667-4a49-a550-06f94171f53e]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG os_brick.utils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating existing volume attachment record: 0261706b-faaa-4fcf-89e3-4c85ef14fd58 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-6fe7b325-8d2f-474e-93ba-3c9bca13fdfd req-bec6298b-dba4-44c8-8fad-4ae9b69fd6d8 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6fe7b325-8d2f-474e-93ba-3c9bca13fdfd req-bec6298b-dba4-44c8-8fad-4ae9b69fd6d8 service nova] Releasing lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Received event network-vif-plugged-cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] Acquiring lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] No waiting events found dispatching network-vif-plugged-cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:04 user nova-compute[74658]: WARNING nova.compute.manager [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Received unexpected event network-vif-plugged-cd4edd24-4702-4a79-af81-025dc029758b for instance with vm_state active and task_state None.
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Received event network-vif-plugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] Acquiring lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] No waiting events found dispatching network-vif-plugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:04 user nova-compute[74658]: WARNING nova.compute.manager [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Received unexpected event network-vif-plugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe for instance with vm_state active and task_state None.
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Received event network-vif-plugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] Acquiring lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] No waiting events found dispatching network-vif-plugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:04 user nova-compute[74658]: WARNING nova.compute.manager [req-7c82d554-49f1-4272-b00e-ea36b3c7dfaf req-60b134eb-d1b1-4865-967e-6363be50c225 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Received unexpected event network-vif-plugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe for instance with vm_state active and task_state None.
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully updated port: 7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Successfully updated port: 5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquired lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-changed-34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing instance network info cache due to event network-changed-34eb8f7c-8d0a-41f7-b221-68bf36c82cec. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:18:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] Acquiring lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [{"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Releasing lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Instance network_info: |[{"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] Acquired lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing network info cache for port 34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updated VIF entry in instance network info cache for port 34eb8f7c-8d0a-41f7-b221-68bf36c82cec. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [{"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] Releasing lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-changed-7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing instance network info cache due to event network-changed-7174d7e9-282f-485b-b06a-8edd4b9ebb52. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] Acquiring lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] Acquired lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:06 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing network info cache for port 7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:18:07 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updated VIF entry in instance network info cache for port 7174d7e9-282f-485b-b06a-8edd4b9ebb52. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:18:07 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [{"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] Releasing lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-changed-5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing instance network info cache due to event network-changed-5057a6c2-fa75-49df-a09f-b782ad2646fa. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:18:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] Acquiring lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] Acquired lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:07 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing network info cache for port 5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:18:07 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updated VIF entry in instance network info cache for port 5057a6c2-fa75-49df-a09f-b782ad2646fa. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:18:07 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [{"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7b14380-fc21-4d44-af19-9352c0a05ccd req-c5f2daf2-4b3f-4965-b136-7269bfb64751 service nova] Releasing lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:09 user nova-compute[74658]: INFO nova.virt.block_device [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Booting with volume 7eff992e-30ec-454d-8afe-0ba59c1e01ba at /dev/vdc
Nov 16 15:18:09 user nova-compute[74658]: DEBUG os_brick.utils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[87360a4a-588f-4e93-ab49-a7fd1e7e7dba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b539eaa3-818b-4b12-a299-93ef0102329f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0af032-9c6c-48be-b2e3-d436168155e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff902374-fd51-4faf-8843-f4c1f6793669]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:18:09 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:18:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[375c21a8-8cb5-4989-93b1-84b87408b064]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG os_brick.utils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:18:09 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating existing volume attachment record: 0a6dc4a8-a29b-4844-8248-4003609da78b {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:18:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:18:14 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Creating image(s)
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Ensure instance console log exists: /opt/stack/data/nova/instances/48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Start _get_guest_xml network_info=[{"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0d16c569-0e9f-49df-9c55-7ca70ba211af', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoKHIgJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2', 'attached_at': '', 'detached_at': '', 'volume_id': '6670f484-f45a-40d3-985f-2f4da8490ef4', 'serial': '6670f484-f45a-40d3-985f-2f4da8490ef4'}, 'boot_index': 0, 'volume_type': None}, {'attachment_id': '0261706b-faaa-4fcf-89e3-4c85ef14fd58', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxhUJgDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2', 'attached_at': '', 'detached_at': '', 'volume_id': '44367556-dcc5-4738-ac00-f8a6c678e3b0', 'serial': '44367556-dcc5-4738-ac00-f8a6c678e3b0'}, 'boot_index': 1, 'volume_type': None}, {'attachment_id': '0a6dc4a8-a29b-4844-8248-4003609da78b', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLcIAYOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2', 'attached_at': '', 'detached_at': '', 'volume_id': '7eff992e-30ec-454d-8afe-0ba59c1e01ba', 'serial': '7eff992e-30ec-454d-8afe-0ba59c1e01ba'}, 'boot_index': 2, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:18:14 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:18:14 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:18:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoKHIgJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:18:15 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:18:15 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:18:15 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[798ef3f6-984f-4798-8870-a6724d3d50cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:18:15 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b905c-1fff-431f-961a-dd417d595f6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4] added
Nov 16 15:18:15 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71d1e79-0a46-40c9-9dc7-b65b0cf48772]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b830d5de-644a-491a-97df-6cafab0c8e42]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoKHIgJc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoKHIgJc" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7821bee-b0b4-498b-a91e-7eb7bbc56109]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RoKHIgJc'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07a3951-9423-440e-b756-eac8da76c520]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73da76c-354a-4e81-8763-85ee7f4fc828]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:15 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:15 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b28bcf-f9fd-45bf-832e-f42345a5de40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4, portal: 172.16.0.220,3260]
Nov 16 15:18:15 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4, portal: 172.16.0.220,3260] successful.
Nov 16 15:18:15 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[73199218-6ecf-47ba-87fe-3f5243616c32]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2af892-64b3-439c-b711-0a8484b1db7c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:15 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:18:15 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:15 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:18:15 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[edea64a4-5ea3-4a66-ad21-7e4aa278c87b]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:18:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoKHIgJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23534356166393936', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534356166393936', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxhUJgDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:18:16 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:18:16 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:18:16 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1e22e2-aba4-42b2-bb22-9e6c76872907]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:18:16 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf5c204-a902-4771-b5b3-bec7de2b7bb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0] added
Nov 16 15:18:16 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[215fef43-5067-4d6d-b926-fb05c456bbaf]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[480f33b2-a7f8-4fa4-9186-c70df097e7b2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxhUJgDu {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxhUJgDu" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce51909-768f-44e7-b232-da9f4e2af585]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KxhUJgDu'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a600a384-3669-476a-b92a-d368d7212717]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef43004-a231-4919-b9fa-f227a4e8ee05]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:16 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:18:16 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:16 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:18:16 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[61911878-fd63-409d-9bd1-7073c32dbc95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0, portal: 172.16.0.220,3260]
Nov 16 15:18:16 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0, portal: 172.16.0.220,3260] successful.
Nov 16 15:18:16 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bf56f6-01e4-4d22-a22b-f497601912a0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fe32d7-1a68-4131-9e89-2bd7995f2e12]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:16 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:18:16 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:18:16 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:16 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:18:16 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:18:16 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[751a644c-9116-4b41-b1e5-9575d66a9243]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxhUJgDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:18:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26237343861613132', 'path': '/dev/sdd'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237343861613132', 'path': '/dev/sdd'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLcIAYOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:18:17 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:18:17 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:18:17 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc7cf29-1623-4f8b-b077-a923d960e7c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:18:17 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdca2033-6079-4b59-884b-8cd2cf4939ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba] added
Nov 16 15:18:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b8ae1e-7eab-40e7-ac57-e3ccb484bc51]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[673c459f-c910-44b7-989d-bf21d54804f8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLcIAYOz {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLcIAYOz" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb0c534-c266-46d7-9fa2-9eb825ac3d13]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QLcIAYOz'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae736578-6ad5-481f-a6c1-49830ac72bd7]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbdbc5c-bbc5-4081-a404-eaf57f3123df]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:17 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:18:17 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:18:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:17 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:18:17 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:18:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3499ee7-1bf9-4642-89f1-b96d6baf4484]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba, portal: 172.16.0.220,3260]
Nov 16 15:18:17 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba, portal: 172.16.0.220,3260] successful.
Nov 16 15:18:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbb9014-05be-4da2-8006-dc020eb251bf]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:18:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[88beb19c-6678-48e3-b251-44aef189dc62]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:18 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:18:18 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:18:18 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:18:18 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:18:18 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:18:18 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:18:18 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:18:18 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5276259-88cc-47a1-87c3-fa9321dd8d6c]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:18:18 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLcIAYOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23266386233643563', 'path': '/dev/sde'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266386233643563', 'path': '/dev/sde'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=bdddb146-3305-47a7-a523-d6430b3d2ced,network=Network(e492e949-8450-47e1-a5b1-016645eafc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdddb146-33') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=a187a46b-1664-43a5-986e-c6abadee65c6,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa187a46b-16') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7b:ca,bridge_name='br-int',has_traffic_filtering=True,id=a61ce95b-32ea-48c9-b694-df72d417424d,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa61ce95b-32') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=2547184e-c859-4452-9e1d-da23edc28844,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2547184e-c8') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:41,bridge_name='br-int',has_traffic_filtering=True,id=34eb8f7c-8d0a-41f7-b221-68bf36c82cec,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34eb8f7c-8d') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:32:00,bridge_name='br-int',has_traffic_filtering=True,id=7174d7e9-282f-485b-b06a-8edd4b9ebb52,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7174d7e9-28') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:6f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5057a6c2-fa75-49df-a09f-b782ad2646fa,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057a6c2-fa') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.objects.instance [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lazy-loading 'pci_devices' on Instance uuid 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:18:19 user nova-compute[74658]:   <uuid>48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2</uuid>
Nov 16 15:18:19 user nova-compute[74658]:   <name>instance-0000000b</name>
Nov 16 15:18:19 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:18:19 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:18:19 user nova-compute[74658]:   <metadata>
Nov 16 15:18:19 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:18:19 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:18:19 user nova-compute[74658]:       <nova:name>tempest-device-tagging-server-279553808</nova:name>
Nov 16 15:18:19 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:18:14</nova:creationTime>
Nov 16 15:18:19 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:18:19 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:18:19 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:18:19 user nova-compute[74658]:       <nova:owner>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:user uuid="cecb346ee3a94c90aedb89436ad41db8">tempest-TaggedBootDevicesTest_v242-355803186-project-member</nova:user>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:project uuid="099c984ee9724b058a8611c5482cdc10">tempest-TaggedBootDevicesTest_v242-355803186</nova:project>
Nov 16 15:18:19 user nova-compute[74658]:       </nova:owner>
Nov 16 15:18:19 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:18:19 user nova-compute[74658]:       <nova:ports>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:port uuid="bdddb146-3305-47a7-a523-d6430b3d2ced">
Nov 16 15:18:19 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 15:18:19 user nova-compute[74658]:         </nova:port>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:port uuid="a187a46b-1664-43a5-986e-c6abadee65c6">
Nov 16 15:18:19 user nova-compute[74658]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Nov 16 15:18:19 user nova-compute[74658]:         </nova:port>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:port uuid="a61ce95b-32ea-48c9-b694-df72d417424d">
Nov 16 15:18:19 user nova-compute[74658]:           <nova:ip type="fixed" address="10.1.1.134" ipVersion="4"/>
Nov 16 15:18:19 user nova-compute[74658]:         </nova:port>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:port uuid="2547184e-c859-4452-9e1d-da23edc28844">
Nov 16 15:18:19 user nova-compute[74658]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Nov 16 15:18:19 user nova-compute[74658]:         </nova:port>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:port uuid="34eb8f7c-8d0a-41f7-b221-68bf36c82cec">
Nov 16 15:18:19 user nova-compute[74658]:           <nova:ip type="fixed" address="10.1.1.105" ipVersion="4"/>
Nov 16 15:18:19 user nova-compute[74658]:         </nova:port>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:port uuid="7174d7e9-282f-485b-b06a-8edd4b9ebb52">
Nov 16 15:18:19 user nova-compute[74658]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 15:18:19 user nova-compute[74658]:         </nova:port>
Nov 16 15:18:19 user nova-compute[74658]:         <nova:port uuid="5057a6c2-fa75-49df-a09f-b782ad2646fa">
Nov 16 15:18:19 user nova-compute[74658]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 15:18:19 user nova-compute[74658]:         </nova:port>
Nov 16 15:18:19 user nova-compute[74658]:       </nova:ports>
Nov 16 15:18:19 user nova-compute[74658]:     </nova:instance>
Nov 16 15:18:19 user nova-compute[74658]:   </metadata>
Nov 16 15:18:19 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:18:19 user nova-compute[74658]:     <system>
Nov 16 15:18:19 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:18:19 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:18:19 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:18:19 user nova-compute[74658]:       <entry name="serial">48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2</entry>
Nov 16 15:18:19 user nova-compute[74658]:       <entry name="uuid">48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2</entry>
Nov 16 15:18:19 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:18:19 user nova-compute[74658]:     </system>
Nov 16 15:18:19 user nova-compute[74658]:   </sysinfo>
Nov 16 15:18:19 user nova-compute[74658]:   <os>
Nov 16 15:18:19 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:18:19 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:18:19 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:18:19 user nova-compute[74658]:   </os>
Nov 16 15:18:19 user nova-compute[74658]:   <features>
Nov 16 15:18:19 user nova-compute[74658]:     <acpi/>
Nov 16 15:18:19 user nova-compute[74658]:     <apic/>
Nov 16 15:18:19 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:18:19 user nova-compute[74658]:   </features>
Nov 16 15:18:19 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:18:19 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:18:19 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:18:19 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:18:19 user nova-compute[74658]:   </clock>
Nov 16 15:18:19 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:18:19 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:18:19 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:18:19 user nova-compute[74658]:   </cpu>
Nov 16 15:18:19 user nova-compute[74658]:   <devices>
Nov 16 15:18:19 user nova-compute[74658]:     <disk type="file" device="cdrom">
Nov 16 15:18:19 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 15:18:19 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2/disk.config"/>
Nov 16 15:18:19 user nova-compute[74658]:       <target dev="hda" bus="ide"/>
Nov 16 15:18:19 user nova-compute[74658]:     </disk>
Nov 16 15:18:19 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:18:19 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:18:19 user nova-compute[74658]:       <source dev="/dev/sdc"/>
Nov 16 15:18:19 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:18:19 user nova-compute[74658]:       <serial>6670f484-f45a-40d3-985f-2f4da8490ef4</serial>
Nov 16 15:18:19 user nova-compute[74658]:     </disk>
Nov 16 15:18:19 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:18:19 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:18:19 user nova-compute[74658]:       <source dev="/dev/sdd"/>
Nov 16 15:18:19 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:18:19 user nova-compute[74658]:       <serial>44367556-dcc5-4738-ac00-f8a6c678e3b0</serial>
Nov 16 15:18:19 user nova-compute[74658]:     </disk>
Nov 16 15:18:19 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:18:19 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:18:19 user nova-compute[74658]:       <source dev="/dev/sde"/>
Nov 16 15:18:19 user nova-compute[74658]:       <target dev="vdc" bus="virtio"/>
Nov 16 15:18:19 user nova-compute[74658]:       <serial>7eff992e-30ec-454d-8afe-0ba59c1e01ba</serial>
Nov 16 15:18:19 user nova-compute[74658]:     </disk>
Nov 16 15:18:19 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:18:19 user nova-compute[74658]:       <mac address="fa:16:3e:21:55:bb"/>
Nov 16 15:18:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:18:19 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:18:19 user nova-compute[74658]:       <target dev="tapbdddb146-33"/>
Nov 16 15:18:19 user nova-compute[74658]:     </interface>
Nov 16 15:18:19 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:18:19 user nova-compute[74658]:       <mac address="fa:16:3e:dd:f2:80"/>
Nov 16 15:18:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:18:19 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:18:19 user nova-compute[74658]:       <target dev="tapa187a46b-16"/>
Nov 16 15:18:19 user nova-compute[74658]:     </interface>
Nov 16 15:18:19 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:18:19 user nova-compute[74658]:       <mac address="fa:16:3e:1e:7b:ca"/>
Nov 16 15:18:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:18:19 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:18:19 user nova-compute[74658]:       <target dev="tapa61ce95b-32"/>
Nov 16 15:18:19 user nova-compute[74658]:     </interface>
Nov 16 15:18:19 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:18:19 user nova-compute[74658]:       <mac address="fa:16:3e:24:2d:26"/>
Nov 16 15:18:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:18:19 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:18:19 user nova-compute[74658]:       <target dev="tap2547184e-c8"/>
Nov 16 15:18:19 user nova-compute[74658]:     </interface>
Nov 16 15:18:19 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:18:19 user nova-compute[74658]:       <mac address="fa:16:3e:68:d1:41"/>
Nov 16 15:18:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:18:19 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:18:19 user nova-compute[74658]:       <target dev="tap34eb8f7c-8d"/>
Nov 16 15:18:19 user nova-compute[74658]:     </interface>
Nov 16 15:18:19 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:18:19 user nova-compute[74658]:       <mac address="fa:16:3e:45:32:00"/>
Nov 16 15:18:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:18:19 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:18:19 user nova-compute[74658]:       <target dev="tap7174d7e9-28"/>
Nov 16 15:18:19 user nova-compute[74658]:     </interface>
Nov 16 15:18:19 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:18:19 user nova-compute[74658]:       <mac address="fa:16:3e:ff:6f:7e"/>
Nov 16 15:18:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:18:19 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:18:19 user nova-compute[74658]:       <target dev="tap5057a6c2-fa"/>
Nov 16 15:18:19 user nova-compute[74658]:     </interface>
Nov 16 15:18:19 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:18:19 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2/console.log" append="off"/>
Nov 16 15:18:19 user nova-compute[74658]:     </serial>
Nov 16 15:18:19 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:18:19 user nova-compute[74658]:     <video>
Nov 16 15:18:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:18:19 user nova-compute[74658]:     </video>
Nov 16 15:18:19 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:18:19 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:18:19 user nova-compute[74658]:     </rng>
Nov 16 15:18:19 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:18:19 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:18:19 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:18:19 user nova-compute[74658]:     </memballoon>
Nov 16 15:18:19 user nova-compute[74658]:   </devices>
Nov 16 15:18:19 user nova-compute[74658]: </domain>
Nov 16 15:18:19 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=bdddb146-3305-47a7-a523-d6430b3d2ced,network=Network(e492e949-8450-47e1-a5b1-016645eafc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdddb146-33') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=bdddb146-3305-47a7-a523-d6430b3d2ced,network=Network(e492e949-8450-47e1-a5b1-016645eafc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdddb146-33') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a866b99c-b1ee-5ff5-ae4f-3c841f69bf0b', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdddb146-33, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbdddb146-33, col_values=(('qos', UUID('2783357a-88df-41b3-9b6a-9eab548de1ae')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbdddb146-33, col_values=(('external_ids', {'iface-id': 'bdddb146-3305-47a7-a523-d6430b3d2ced', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:55:bb', 'vm-uuid': '48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: INFO os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=bdddb146-3305-47a7-a523-d6430b3d2ced,network=Network(e492e949-8450-47e1-a5b1-016645eafc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdddb146-33')
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=a187a46b-1664-43a5-986e-c6abadee65c6,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa187a46b-16') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=a187a46b-1664-43a5-986e-c6abadee65c6,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa187a46b-16') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f52fa79-9529-5507-9806-7d6b48ad533b', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa187a46b-16, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa187a46b-16, col_values=(('qos', UUID('f70720f6-190b-4413-86bd-795f1332d88b')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa187a46b-16, col_values=(('external_ids', {'iface-id': 'a187a46b-1664-43a5-986e-c6abadee65c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:f2:80', 'vm-uuid': '48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: INFO os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=a187a46b-1664-43a5-986e-c6abadee65c6,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa187a46b-16')
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7b:ca,bridge_name='br-int',has_traffic_filtering=True,id=a61ce95b-32ea-48c9-b694-df72d417424d,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa61ce95b-32') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7b:ca,bridge_name='br-int',has_traffic_filtering=True,id=a61ce95b-32ea-48c9-b694-df72d417424d,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa61ce95b-32') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8958b5ff-5972-537a-ba7a-4f5f5f5089e7', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa61ce95b-32, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa61ce95b-32, col_values=(('qos', UUID('4bd96574-8eab-4b69-8e35-59098884f87a')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa61ce95b-32, col_values=(('external_ids', {'iface-id': 'a61ce95b-32ea-48c9-b694-df72d417424d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:7b:ca', 'vm-uuid': '48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: INFO os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7b:ca,bridge_name='br-int',has_traffic_filtering=True,id=a61ce95b-32ea-48c9-b694-df72d417424d,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa61ce95b-32')
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=2547184e-c859-4452-9e1d-da23edc28844,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2547184e-c8') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=2547184e-c859-4452-9e1d-da23edc28844,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2547184e-c8') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4be2e63-23aa-52b1-a491-a539c959ce3d', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2547184e-c8, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2547184e-c8, col_values=(('qos', UUID('e9aa5f0c-84d1-4a40-89df-64ed973581dc')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2547184e-c8, col_values=(('external_ids', {'iface-id': '2547184e-c859-4452-9e1d-da23edc28844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:2d:26', 'vm-uuid': '48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: INFO os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=2547184e-c859-4452-9e1d-da23edc28844,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2547184e-c8')
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:41,bridge_name='br-int',has_traffic_filtering=True,id=34eb8f7c-8d0a-41f7-b221-68bf36c82cec,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34eb8f7c-8d') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:41,bridge_name='br-int',has_traffic_filtering=True,id=34eb8f7c-8d0a-41f7-b221-68bf36c82cec,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34eb8f7c-8d') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a47c5bbf-3133-553b-a9dd-0cb5ec7065ce', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34eb8f7c-8d, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34eb8f7c-8d, col_values=(('qos', UUID('f59e121e-d339-463c-b02d-2467820d61fb')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34eb8f7c-8d, col_values=(('external_ids', {'iface-id': '34eb8f7c-8d0a-41f7-b221-68bf36c82cec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:d1:41', 'vm-uuid': '48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: INFO os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:41,bridge_name='br-int',has_traffic_filtering=True,id=34eb8f7c-8d0a-41f7-b221-68bf36c82cec,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34eb8f7c-8d')
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:32:00,bridge_name='br-int',has_traffic_filtering=True,id=7174d7e9-282f-485b-b06a-8edd4b9ebb52,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7174d7e9-28') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:32:00,bridge_name='br-int',has_traffic_filtering=True,id=7174d7e9-282f-485b-b06a-8edd4b9ebb52,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7174d7e9-28') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a63dd4d-8c84-5b25-93ad-d0c335e368db', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7174d7e9-28, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7174d7e9-28, col_values=(('qos', UUID('2eb723cd-0c50-4bf3-8fc2-29d2dea3471d')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7174d7e9-28, col_values=(('external_ids', {'iface-id': '7174d7e9-282f-485b-b06a-8edd4b9ebb52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:32:00', 'vm-uuid': '48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: INFO os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:32:00,bridge_name='br-int',has_traffic_filtering=True,id=7174d7e9-282f-485b-b06a-8edd4b9ebb52,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7174d7e9-28')
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:6f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5057a6c2-fa75-49df-a09f-b782ad2646fa,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057a6c2-fa') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:6f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5057a6c2-fa75-49df-a09f-b782ad2646fa,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057a6c2-fa') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd377b045-f03a-5644-9cac-8b8475f239fb', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5057a6c2-fa, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5057a6c2-fa, col_values=(('qos', UUID('f6ab594f-6bed-4af8-aec9-ecffe04cebc6')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5057a6c2-fa, col_values=(('external_ids', {'iface-id': '5057a6c2-fa75-49df-a09f-b782ad2646fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:6f:7e', 'vm-uuid': '48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:19 user nova-compute[74658]: INFO os_vif [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:6f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5057a6c2-fa75-49df-a09f-b782ad2646fa,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057a6c2-fa')
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] No BDM found with device name hda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] No VIF found with MAC fa:16:3e:21:55:bb, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:18:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] No VIF found with MAC fa:16:3e:68:d1:41, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:18:19 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Using config drive
Nov 16 15:18:19 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Creating config drive at /opt/stack/data/nova/instances/48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2/disk.config
Nov 16 15:18:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnf90tj4x {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnf90tj4x" returned: 0 in 0.052s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8ca47d0-546a-42ac-a61e-b812f3a48da9 req-ce360206-10f9-4186-86c0-b0e0d673663f service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8ca47d0-546a-42ac-a61e-b812f3a48da9 req-ce360206-10f9-4186-86c0-b0e0d673663f service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8ca47d0-546a-42ac-a61e-b812f3a48da9 req-ce360206-10f9-4186-86c0-b0e0d673663f service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8ca47d0-546a-42ac-a61e-b812f3a48da9 req-ce360206-10f9-4186-86c0-b0e0d673663f service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8ca47d0-546a-42ac-a61e-b812f3a48da9 req-ce360206-10f9-4186-86c0-b0e0d673663f service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:21 user nova-compute[74658]: WARNING nova.compute.manager [req-a8ca47d0-546a-42ac-a61e-b812f3a48da9 req-ce360206-10f9-4186-86c0-b0e0d673663f service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-bdddb146-3305-47a7-a523-d6430b3d2ced for instance with vm_state building and task_state spawning.
Nov 16 15:18:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-26a46f39-a886-4fa0-af22-3e04369190e0 req-b6de5518-4d9a-479f-a48f-599422d1cc6f service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-a61ce95b-32ea-48c9-b694-df72d417424d {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-26a46f39-a886-4fa0-af22-3e04369190e0 req-b6de5518-4d9a-479f-a48f-599422d1cc6f service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-26a46f39-a886-4fa0-af22-3e04369190e0 req-b6de5518-4d9a-479f-a48f-599422d1cc6f service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-26a46f39-a886-4fa0-af22-3e04369190e0 req-b6de5518-4d9a-479f-a48f-599422d1cc6f service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-26a46f39-a886-4fa0-af22-3e04369190e0 req-b6de5518-4d9a-479f-a48f-599422d1cc6f service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-a61ce95b-32ea-48c9-b694-df72d417424d {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:22 user nova-compute[74658]: WARNING nova.compute.manager [req-26a46f39-a886-4fa0-af22-3e04369190e0 req-b6de5518-4d9a-479f-a48f-599422d1cc6f service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-a61ce95b-32ea-48c9-b694-df72d417424d for instance with vm_state building and task_state spawning.
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-e22011e8-7f0c-4599-a563-e8266789daa3 req-94b9f127-63a9-41a6-af7e-0a86623f0adf service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e22011e8-7f0c-4599-a563-e8266789daa3 req-94b9f127-63a9-41a6-af7e-0a86623f0adf service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e22011e8-7f0c-4599-a563-e8266789daa3 req-94b9f127-63a9-41a6-af7e-0a86623f0adf service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e22011e8-7f0c-4599-a563-e8266789daa3 req-94b9f127-63a9-41a6-af7e-0a86623f0adf service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-e22011e8-7f0c-4599-a563-e8266789daa3 req-94b9f127-63a9-41a6-af7e-0a86623f0adf service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:23 user nova-compute[74658]: WARNING nova.compute.manager [req-e22011e8-7f0c-4599-a563-e8266789daa3 req-94b9f127-63a9-41a6-af7e-0a86623f0adf service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-5057a6c2-fa75-49df-a09f-b782ad2646fa for instance with vm_state building and task_state spawning.
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:23 user nova-compute[74658]: WARNING nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-bdddb146-3305-47a7-a523-d6430b3d2ced for instance with vm_state building and task_state spawning.
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-a187a46b-1664-43a5-986e-c6abadee65c6 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-a187a46b-1664-43a5-986e-c6abadee65c6 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:23 user nova-compute[74658]: WARNING nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-a187a46b-1664-43a5-986e-c6abadee65c6 for instance with vm_state building and task_state spawning.
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-a187a46b-1664-43a5-986e-c6abadee65c6 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-a187a46b-1664-43a5-986e-c6abadee65c6 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:23 user nova-compute[74658]: WARNING nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-a187a46b-1664-43a5-986e-c6abadee65c6 for instance with vm_state building and task_state spawning.
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:23 user nova-compute[74658]: WARNING nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-2547184e-c859-4452-9e1d-da23edc28844 for instance with vm_state building and task_state spawning.
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:23 user nova-compute[74658]: WARNING nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-2547184e-c859-4452-9e1d-da23edc28844 for instance with vm_state building and task_state spawning.
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:23 user nova-compute[74658]: WARNING nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec for instance with vm_state building and task_state spawning.
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:23 user nova-compute[74658]: WARNING nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec for instance with vm_state building and task_state spawning.
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:23 user nova-compute[74658]: WARNING nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 for instance with vm_state building and task_state spawning.
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:23 user nova-compute[74658]: WARNING nova.compute.manager [req-27404ad9-336b-4e44-be67-9fbbb6715547 req-9a05fa77-23d4-4cf1-ae4b-f5e48ba1d0e3 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 for instance with vm_state building and task_state spawning.
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG nova.compute.manager [req-2f047146-a79d-4316-8e24-c4989cf4b0f5 req-61845987-8d12-4cc5-bcb8-edbf6948aed4 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-a61ce95b-32ea-48c9-b694-df72d417424d {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2f047146-a79d-4316-8e24-c4989cf4b0f5 req-61845987-8d12-4cc5-bcb8-edbf6948aed4 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2f047146-a79d-4316-8e24-c4989cf4b0f5 req-61845987-8d12-4cc5-bcb8-edbf6948aed4 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2f047146-a79d-4316-8e24-c4989cf4b0f5 req-61845987-8d12-4cc5-bcb8-edbf6948aed4 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG nova.compute.manager [req-2f047146-a79d-4316-8e24-c4989cf4b0f5 req-61845987-8d12-4cc5-bcb8-edbf6948aed4 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-a61ce95b-32ea-48c9-b694-df72d417424d {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:24 user nova-compute[74658]: WARNING nova.compute.manager [req-2f047146-a79d-4316-8e24-c4989cf4b0f5 req-61845987-8d12-4cc5-bcb8-edbf6948aed4 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-a61ce95b-32ea-48c9-b694-df72d417424d for instance with vm_state building and task_state spawning.
Nov 16 15:18:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:18:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Instance spawned successfully.
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-94744a8e-9fee-4767-b34b-0a8c66706824 req-f836d505-e297-44cc-9ff3-eeb35d02416d service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-94744a8e-9fee-4767-b34b-0a8c66706824 req-f836d505-e297-44cc-9ff3-eeb35d02416d service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-94744a8e-9fee-4767-b34b-0a8c66706824 req-f836d505-e297-44cc-9ff3-eeb35d02416d service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-94744a8e-9fee-4767-b34b-0a8c66706824 req-f836d505-e297-44cc-9ff3-eeb35d02416d service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-94744a8e-9fee-4767-b34b-0a8c66706824 req-f836d505-e297-44cc-9ff3-eeb35d02416d service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:18:25 user nova-compute[74658]: WARNING nova.compute.manager [req-94744a8e-9fee-4767-b34b-0a8c66706824 req-f836d505-e297-44cc-9ff3-eeb35d02416d service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-5057a6c2-fa75-49df-a09f-b782ad2646fa for instance with vm_state building and task_state spawning.
Nov 16 15:18:25 user nova-compute[74658]: INFO nova.compute.manager [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Took 10.77 seconds to spawn the instance on the hypervisor.
Nov 16 15:18:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:18:25 user nova-compute[74658]: INFO nova.compute.manager [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Took 30.89 seconds to build instance.
Nov 16 15:18:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9139c7cc-851d-42c9-8295-79b7ae97cddd tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.044s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:18:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:18:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:18:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:18:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:18:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:18:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:18:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:18:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-ef43a5fd-46d1-47e5-bbf1-4d3f3dbaa157 req-784c8639-d621-4f37-895e-169afcaeb34b service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received event network-changed-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-ef43a5fd-46d1-47e5-bbf1-4d3f3dbaa157 req-784c8639-d621-4f37-895e-169afcaeb34b service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Refreshing instance network info cache due to event network-changed-4999888f-3310-45f7-bc33-8180b8110ef9. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:18:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ef43a5fd-46d1-47e5-bbf1-4d3f3dbaa157 req-784c8639-d621-4f37-895e-169afcaeb34b service nova] Acquiring lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ef43a5fd-46d1-47e5-bbf1-4d3f3dbaa157 req-784c8639-d621-4f37-895e-169afcaeb34b service nova] Acquired lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:53 user nova-compute[74658]: DEBUG nova.network.neutron [req-ef43a5fd-46d1-47e5-bbf1-4d3f3dbaa157 req-784c8639-d621-4f37-895e-169afcaeb34b service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Refreshing network info cache for port 4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:18:53 user nova-compute[74658]: DEBUG nova.network.neutron [req-ef43a5fd-46d1-47e5-bbf1-4d3f3dbaa157 req-784c8639-d621-4f37-895e-169afcaeb34b service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updated VIF entry in instance network info cache for port 4999888f-3310-45f7-bc33-8180b8110ef9. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:18:53 user nova-compute[74658]: DEBUG nova.network.neutron [req-ef43a5fd-46d1-47e5-bbf1-4d3f3dbaa157 req-784c8639-d621-4f37-895e-169afcaeb34b service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updating instance_info_cache with network_info: [{"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ef43a5fd-46d1-47e5-bbf1-4d3f3dbaa157 req-784c8639-d621-4f37-895e-169afcaeb34b service nova] Releasing lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "7a8d82d1-5263-472d-8491-1abc709404dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "7a8d82d1-5263-472d-8491-1abc709404dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:18:55 user nova-compute[74658]: INFO nova.compute.claims [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Claim successful on node user
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.network.neutron [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:18:55 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:18:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG nova.policy [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3ab7f89ab8d49c2a0f526c4c09a3b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af743d7342e44f64ae98c2d596eb63b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG nova.compute.manager [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:18:56 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Creating image(s)
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "/opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "/opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc2ac2b1-b885-4687-b64a-7c0fa3ccd00c req-338b7b3e-d0f2-406b-b6ec-8a786ff0ad6f service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-changed-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc2ac2b1-b885-4687-b64a-7c0fa3ccd00c req-338b7b3e-d0f2-406b-b6ec-8a786ff0ad6f service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Refreshing instance network info cache due to event network-changed-a370fa54-9887-42af-b8e5-ab80c536cccd. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc2ac2b1-b885-4687-b64a-7c0fa3ccd00c req-338b7b3e-d0f2-406b-b6ec-8a786ff0ad6f service nova] Acquiring lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc2ac2b1-b885-4687-b64a-7c0fa3ccd00c req-338b7b3e-d0f2-406b-b6ec-8a786ff0ad6f service nova] Acquired lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG nova.network.neutron [req-fc2ac2b1-b885-4687-b64a-7c0fa3ccd00c req-338b7b3e-d0f2-406b-b6ec-8a786ff0ad6f service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Refreshing network info cache for port a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.222s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG nova.network.neutron [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Successfully created port: 4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk 1073741824" returned: 0 in 0.051s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Cannot resize image /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Ensure instance console log exists: /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.network.neutron [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Successfully updated port: 4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lazy-loading 'flavor' on Instance uuid c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "refresh_cache-7a8d82d1-5263-472d-8491-1abc709404dd" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquired lock "refresh_cache-7a8d82d1-5263-472d-8491-1abc709404dd" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.network.neutron [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.compute.manager [req-26d95eb8-ce1a-42f0-8e6a-afeb60d0c89d req-162b5a67-b105-4e4b-bbeb-62b2090232c6 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Received event network-changed-4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.compute.manager [req-26d95eb8-ce1a-42f0-8e6a-afeb60d0c89d req-162b5a67-b105-4e4b-bbeb-62b2090232c6 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Refreshing instance network info cache due to event network-changed-4f55927a-4754-4029-af3f-a5758d8d1793. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-26d95eb8-ce1a-42f0-8e6a-afeb60d0c89d req-162b5a67-b105-4e4b-bbeb-62b2090232c6 service nova] Acquiring lock "refresh_cache-7a8d82d1-5263-472d-8491-1abc709404dd" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.network.neutron [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:18:57 user nova-compute[74658]: INFO nova.compute.manager [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Attaching volume 561dfed6-9424-4d0a-84ce-39ea50f19bc2 to /dev/vdb
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.network.neutron [req-fc2ac2b1-b885-4687-b64a-7c0fa3ccd00c req-338b7b3e-d0f2-406b-b6ec-8a786ff0ad6f service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updated VIF entry in instance network info cache for port a370fa54-9887-42af-b8e5-ab80c536cccd. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.network.neutron [req-fc2ac2b1-b885-4687-b64a-7c0fa3ccd00c req-338b7b3e-d0f2-406b-b6ec-8a786ff0ad6f service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updating instance_info_cache with network_info: [{"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG os_brick.utils [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc2ac2b1-b885-4687-b64a-7c0fa3ccd00c req-338b7b3e-d0f2-406b-b6ec-8a786ff0ad6f service nova] Releasing lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[973798b4-611b-4953-88bd-e3e1bcded89f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[574a627f-d7b5-44f9-98d5-ed4612fc4d13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6bf6cc-79b5-442e-9173-52707476bf45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a541fd37-d0e5-4d33-8a05-992fa382910e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:18:57 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa3728f-d603-49d8-8852-488abd538859]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.network.neutron [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Updating instance_info_cache with network_info: [{"id": "4f55927a-4754-4029-af3f-a5758d8d1793", "address": "fa:16:3e:0e:9e:7a", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f55927a-47", "ovs_interfaceid": "4f55927a-4754-4029-af3f-a5758d8d1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.compute.manager [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG os_brick.utils [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] <== get_connector_properties: return (246ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Updating existing volume attachment record: bde8b34b-75c0-4270-8447-e2a9821ab8a0 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Releasing lock "refresh_cache-7a8d82d1-5263-472d-8491-1abc709404dd" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.compute.manager [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Instance network_info: |[{"id": "4f55927a-4754-4029-af3f-a5758d8d1793", "address": "fa:16:3e:0e:9e:7a", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f55927a-47", "ovs_interfaceid": "4f55927a-4754-4029-af3f-a5758d8d1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-26d95eb8-ce1a-42f0-8e6a-afeb60d0c89d req-162b5a67-b105-4e4b-bbeb-62b2090232c6 service nova] Acquired lock "refresh_cache-7a8d82d1-5263-472d-8491-1abc709404dd" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.network.neutron [req-26d95eb8-ce1a-42f0-8e6a-afeb60d0c89d req-162b5a67-b105-4e4b-bbeb-62b2090232c6 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Refreshing network info cache for port 4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Start _get_guest_xml network_info=[{"id": "4f55927a-4754-4029-af3f-a5758d8d1793", "address": "fa:16:3e:0e:9e:7a", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f55927a-47", "ovs_interfaceid": "4f55927a-4754-4029-af3f-a5758d8d1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:18:57 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:18:57 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2077344507',display_name='tempest-ServersNegativeTestJSON-server-2077344507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2077344507',id=12,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af743d7342e44f64ae98c2d596eb63b1',ramdisk_id='',reservation_id='r-b0ava4km',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-143070094',owner_user_name='tempest-ServersNegativeTestJSON-143070094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:18:56Z,user_data=None,user_id='d3ab7f89ab8d49c2a0f526c4c09a3b94',uuid=7a8d82d1-5263-472d-8491-1abc709404dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f55927a-4754-4029-af3f-a5758d8d1793", "address": "fa:16:3e:0e:9e:7a", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f55927a-47", "ovs_interfaceid": "4f55927a-4754-4029-af3f-a5758d8d1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converting VIF {"id": "4f55927a-4754-4029-af3f-a5758d8d1793", "address": "fa:16:3e:0e:9e:7a", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f55927a-47", "ovs_interfaceid": "4f55927a-4754-4029-af3f-a5758d8d1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:9e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f55927a-4754-4029-af3f-a5758d8d1793,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f55927a-47') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.objects.instance [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a8d82d1-5263-472d-8491-1abc709404dd {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:18:57 user nova-compute[74658]: INFO nova.compute.manager [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] instance snapshotting
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:18:57 user nova-compute[74658]:   <uuid>7a8d82d1-5263-472d-8491-1abc709404dd</uuid>
Nov 16 15:18:57 user nova-compute[74658]:   <name>instance-0000000c</name>
Nov 16 15:18:57 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:18:57 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:18:57 user nova-compute[74658]:   <metadata>
Nov 16 15:18:57 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:18:57 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:18:57 user nova-compute[74658]:       <nova:name>tempest-ServersNegativeTestJSON-server-2077344507</nova:name>
Nov 16 15:18:57 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:18:57</nova:creationTime>
Nov 16 15:18:57 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:18:57 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:18:57 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:18:57 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:18:57 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:18:57 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:18:57 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:18:57 user nova-compute[74658]:       <nova:owner>
Nov 16 15:18:57 user nova-compute[74658]:         <nova:user uuid="d3ab7f89ab8d49c2a0f526c4c09a3b94">tempest-ServersNegativeTestJSON-143070094-project-member</nova:user>
Nov 16 15:18:57 user nova-compute[74658]:         <nova:project uuid="af743d7342e44f64ae98c2d596eb63b1">tempest-ServersNegativeTestJSON-143070094</nova:project>
Nov 16 15:18:57 user nova-compute[74658]:       </nova:owner>
Nov 16 15:18:57 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:18:57 user nova-compute[74658]:       <nova:ports>
Nov 16 15:18:57 user nova-compute[74658]:         <nova:port uuid="4f55927a-4754-4029-af3f-a5758d8d1793">
Nov 16 15:18:57 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 15:18:57 user nova-compute[74658]:         </nova:port>
Nov 16 15:18:57 user nova-compute[74658]:       </nova:ports>
Nov 16 15:18:57 user nova-compute[74658]:     </nova:instance>
Nov 16 15:18:57 user nova-compute[74658]:   </metadata>
Nov 16 15:18:57 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:18:57 user nova-compute[74658]:     <system>
Nov 16 15:18:57 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:18:57 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:18:57 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:18:57 user nova-compute[74658]:       <entry name="serial">7a8d82d1-5263-472d-8491-1abc709404dd</entry>
Nov 16 15:18:57 user nova-compute[74658]:       <entry name="uuid">7a8d82d1-5263-472d-8491-1abc709404dd</entry>
Nov 16 15:18:57 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:18:57 user nova-compute[74658]:     </system>
Nov 16 15:18:57 user nova-compute[74658]:   </sysinfo>
Nov 16 15:18:57 user nova-compute[74658]:   <os>
Nov 16 15:18:57 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:18:57 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:18:57 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:18:57 user nova-compute[74658]:   </os>
Nov 16 15:18:57 user nova-compute[74658]:   <features>
Nov 16 15:18:57 user nova-compute[74658]:     <acpi/>
Nov 16 15:18:57 user nova-compute[74658]:     <apic/>
Nov 16 15:18:57 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:18:57 user nova-compute[74658]:   </features>
Nov 16 15:18:57 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:18:57 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:18:57 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:18:57 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:18:57 user nova-compute[74658]:   </clock>
Nov 16 15:18:57 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:18:57 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:18:57 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:18:57 user nova-compute[74658]:   </cpu>
Nov 16 15:18:57 user nova-compute[74658]:   <devices>
Nov 16 15:18:57 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:18:57 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:18:57 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk"/>
Nov 16 15:18:57 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:18:57 user nova-compute[74658]:     </disk>
Nov 16 15:18:57 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:18:57 user nova-compute[74658]:       <mac address="fa:16:3e:0e:9e:7a"/>
Nov 16 15:18:57 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:18:57 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:18:57 user nova-compute[74658]:       <target dev="tap4f55927a-47"/>
Nov 16 15:18:57 user nova-compute[74658]:     </interface>
Nov 16 15:18:57 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:18:57 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/console.log" append="off"/>
Nov 16 15:18:57 user nova-compute[74658]:     </serial>
Nov 16 15:18:57 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:18:57 user nova-compute[74658]:     <video>
Nov 16 15:18:57 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:18:57 user nova-compute[74658]:     </video>
Nov 16 15:18:57 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:18:57 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:18:57 user nova-compute[74658]:     </rng>
Nov 16 15:18:57 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:18:57 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:18:57 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:18:57 user nova-compute[74658]:     </memballoon>
Nov 16 15:18:57 user nova-compute[74658]:   </devices>
Nov 16 15:18:57 user nova-compute[74658]: </domain>
Nov 16 15:18:57 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2077344507',display_name='tempest-ServersNegativeTestJSON-server-2077344507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2077344507',id=12,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af743d7342e44f64ae98c2d596eb63b1',ramdisk_id='',reservation_id='r-b0ava4km',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-143070094',owner_user_name='tempest-ServersNegativeTestJSON-143070094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:18:56Z,user_data=None,user_id='d3ab7f89ab8d49c2a0f526c4c09a3b94',uuid=7a8d82d1-5263-472d-8491-1abc709404dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f55927a-4754-4029-af3f-a5758d8d1793", "address": "fa:16:3e:0e:9e:7a", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f55927a-47", "ovs_interfaceid": "4f55927a-4754-4029-af3f-a5758d8d1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converting VIF {"id": "4f55927a-4754-4029-af3f-a5758d8d1793", "address": "fa:16:3e:0e:9e:7a", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f55927a-47", "ovs_interfaceid": "4f55927a-4754-4029-af3f-a5758d8d1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:9e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f55927a-4754-4029-af3f-a5758d8d1793,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f55927a-47') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG os_vif [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:9e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f55927a-4754-4029-af3f-a5758d8d1793,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f55927a-47') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97ac9856-883c-5fcd-81f4-b9b58b9bcea2', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f55927a-47, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f55927a-47, col_values=(('qos', UUID('46c17903-eae4-485e-af96-632688aeb65d')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f55927a-47, col_values=(('external_ids', {'iface-id': '4f55927a-4754-4029-af3f-a5758d8d1793', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:9e:7a', 'vm-uuid': '7a8d82d1-5263-472d-8491-1abc709404dd'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:18:57 user nova-compute[74658]: INFO os_vif [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:9e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f55927a-4754-4029-af3f-a5758d8d1793,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f55927a-47')
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:18:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:18:58 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Beginning live snapshot process
Nov 16 15:18:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:18:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] No VIF found with MAC fa:16:3e:0e:9e:7a, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:18:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-26d95eb8-ce1a-42f0-8e6a-afeb60d0c89d req-162b5a67-b105-4e4b-bbeb-62b2090232c6 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Updated VIF entry in instance network info cache for port 4f55927a-4754-4029-af3f-a5758d8d1793. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-26d95eb8-ce1a-42f0-8e6a-afeb60d0c89d req-162b5a67-b105-4e4b-bbeb-62b2090232c6 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Updating instance_info_cache with network_info: [{"id": "4f55927a-4754-4029-af3f-a5758d8d1793", "address": "fa:16:3e:0e:9e:7a", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f55927a-47", "ovs_interfaceid": "4f55927a-4754-4029-af3f-a5758d8d1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-778bab76-367a-472d-8b5a-ced8fc074397 req-67b243b7-9aa4-4540-80de-d7c2abbde883 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-changed-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-778bab76-367a-472d-8b5a-ced8fc074397 req-67b243b7-9aa4-4540-80de-d7c2abbde883 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Refreshing instance network info cache due to event network-changed-6abed81e-257d-4d47-a1b8-586c040fdc92. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-778bab76-367a-472d-8b5a-ced8fc074397 req-67b243b7-9aa4-4540-80de-d7c2abbde883 service nova] Acquiring lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-778bab76-367a-472d-8b5a-ced8fc074397 req-67b243b7-9aa4-4540-80de-d7c2abbde883 service nova] Acquired lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-778bab76-367a-472d-8b5a-ced8fc074397 req-67b243b7-9aa4-4540-80de-d7c2abbde883 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Refreshing network info cache for port 6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Received event network-vif-plugged-4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] Acquiring lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] Lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] Lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] No waiting events found dispatching network-vif-plugged-4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:01 user nova-compute[74658]: WARNING nova.compute.manager [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Received unexpected event network-vif-plugged-4f55927a-4754-4029-af3f-a5758d8d1793 for instance with vm_state building and task_state spawning.
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Received event network-vif-plugged-4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] Acquiring lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] Lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] Lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] No waiting events found dispatching network-vif-plugged-4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:01 user nova-compute[74658]: WARNING nova.compute.manager [req-fd0b3678-69ce-494e-9fad-082499d6644d req-85608384-1739-4255-af52-3ca6cd192a51 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Received unexpected event network-vif-plugged-4f55927a-4754-4029-af3f-a5758d8d1793 for instance with vm_state building and task_state spawning.
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-26d95eb8-ce1a-42f0-8e6a-afeb60d0c89d req-162b5a67-b105-4e4b-bbeb-62b2090232c6 service nova] Releasing lock "refresh_cache-7a8d82d1-5263-472d-8491-1abc709404dd" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json -f qcow2 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:01 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:19:01 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=6971MB free_disk=25.636043548583984GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Instance spawned successfully.
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json -f qcow2 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:01 user nova-compute[74658]: INFO nova.compute.manager [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 16 15:19:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 11bd9639-1c9e-4080-bd89-bf34724684d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance a2f77c43-8afd-465a-bb09-537cc3c6461d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance d497d108-2eb4-448d-9d1f-e8864e0b48a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 03cbebbf-5414-4309-bfc1-ec0a67e09a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7a8d82d1-5263-472d-8491-1abc709404dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e06fcb99-9271-48da-ac95-3998d45e6ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 51f00d67-ae3d-4d1b-a721-280bae2e9caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json -f qcow2" returned: 0 in 0.266s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:02 user nova-compute[74658]: INFO nova.compute.manager [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Took 7.05 seconds to build instance.
Nov 16 15:19:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-46d78ff9-7196-47fe-b06d-68b95d14cff7 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "7a8d82d1-5263-472d-8491-1abc709404dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.159s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.188s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv90zbgxi/b70337bf51444c66b0f1c6dbbbf78ef1.delta 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv90zbgxi/b70337bf51444c66b0f1c6dbbbf78ef1.delta 1073741824" returned: 0 in 0.049s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74658) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 16 15:19:02 user nova-compute[74658]: INFO nova.virt.libvirt.host [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] UEFI support detected
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.network.neutron [req-778bab76-367a-472d-8b5a-ced8fc074397 req-67b243b7-9aa4-4540-80de-d7c2abbde883 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updated VIF entry in instance network info cache for port 6abed81e-257d-4d47-a1b8-586c040fdc92. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.network.neutron [req-778bab76-367a-472d-8b5a-ced8fc074397 req-67b243b7-9aa4-4540-80de-d7c2abbde883 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating instance_info_cache with network_info: [{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-778bab76-367a-472d-8b5a-ced8fc074397 req-67b243b7-9aa4-4540-80de-d7c2abbde883 service nova] Releasing lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.836s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzKDbMEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:03 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:03 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:03 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8978484-d323-4eac-b4d4-768f2542017c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:19:03 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3374762-afc7-43fb-b9c7-ee8431aceae7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2] added
Nov 16 15:19:03 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] COPY block job progress, current cursor: 12451840 final cursor: 75563008 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.107s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11ae193-4bd0-4993-8a65-6a936cbad6be]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.093s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[538ed81a-843c-45b3-b5e2-b2ec91cd6459]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzKDbMEg {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzKDbMEg" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[df57ebc0-d5c5-4808-bc00-0fad4cd8de03]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GzKDbMEg'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c4260b-4b06-4cdc-b61b-208729b7a9b3]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[da55b5e8-5f94-4691-9af1-2286f5386ba4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:03 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:03 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:03 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:03 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:03 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:03 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:03 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:03 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:19:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:19:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 15:19:04 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv90zbgxi/b70337bf51444c66b0f1c6dbbbf78ef1.delta /opt/stack/data/nova/instances/snapshots/tmpv90zbgxi/b70337bf51444c66b0f1c6dbbbf78ef1 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Updating instance_info_cache with network_info: [{"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --login" returned: 0 in 1.105s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d114a6-8814-4599-b30e-d372e16b31d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2, portal: 172.16.0.220,3260]
Nov 16 15:19:04 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv90zbgxi/b70337bf51444c66b0f1c6dbbbf78ef1.delta /opt/stack/data/nova/instances/snapshots/tmpv90zbgxi/b70337bf51444c66b0f1c6dbbbf78ef1" returned: 0 in 0.706s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Snapshot extracted, beginning image upload
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ad3c43-46d0-425f-8b9b-95172d5a1e5d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6691489c-3333-4c47-b528-7eb9e69d0121]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:04 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:04 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:04 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:04 user nova-compute[74658]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 (non-flash)
Nov 16 15:19:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:04 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:04 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:04 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:04 user nova-compute[74658]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 (non-flash)
Nov 16 15:19:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.923s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:19:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[78462d32-dd7a-4cca-8a51-00420b45693d]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:05 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:19:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzKDbMEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:19:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.960s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] <== connect_volume: return (2963ms) {'type': 'block', 'scsi_wwn': '23136623836323530', 'path': '/dev/sdf'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136623836323530', 'path': '/dev/sdf'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:19:06 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lazy-loading 'flavor' on Instance uuid c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:19:06 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:06 user nova-compute[74658]:   <source dev="/dev/sdf"/>
Nov 16 15:19:06 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:19:06 user nova-compute[74658]:   <serial>561dfed6-9424-4d0a-84ce-39ea50f19bc2</serial>
Nov 16 15:19:06 user nova-compute[74658]: </disk>
Nov 16 15:19:06 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:19:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] No VIF found with MAC fa:16:3e:b4:11:7c, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:19:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ca07c766-0078-43a8-8c94-f1cdeff98246 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.259s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:07 user nova-compute[74658]: INFO nova.compute.manager [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Terminating instance
Nov 16 15:19:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:19:07 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Snapshot image upload complete
Nov 16 15:19:07 user nova-compute[74658]: INFO nova.compute.manager [None req-024769b9-d908-486f-b7ce-7151425d6320 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Took 10.06 seconds to snapshot the instance on the hypervisor.
Nov 16 15:19:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-f6e5c7e5-2366-4ba6-b7bf-819dd9c4cdb9 req-d87adc40-bf71-4503-b441-820ce204d84f service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Received event network-vif-unplugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f6e5c7e5-2366-4ba6-b7bf-819dd9c4cdb9 req-d87adc40-bf71-4503-b441-820ce204d84f service nova] Acquiring lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f6e5c7e5-2366-4ba6-b7bf-819dd9c4cdb9 req-d87adc40-bf71-4503-b441-820ce204d84f service nova] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f6e5c7e5-2366-4ba6-b7bf-819dd9c4cdb9 req-d87adc40-bf71-4503-b441-820ce204d84f service nova] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-f6e5c7e5-2366-4ba6-b7bf-819dd9c4cdb9 req-d87adc40-bf71-4503-b441-820ce204d84f service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] No waiting events found dispatching network-vif-unplugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-f6e5c7e5-2366-4ba6-b7bf-819dd9c4cdb9 req-d87adc40-bf71-4503-b441-820ce204d84f service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Received event network-vif-unplugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:19:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Instance destroyed successfully.
Nov 16 15:19:08 user nova-compute[74658]: DEBUG nova.objects.instance [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lazy-loading 'resources' on Instance uuid c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2003535367',display_name='tempest-DeleteServersTestJSON-server-2003535367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2003535367',id=3,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d64a18a74e140f0bd504f507af25d6d',ramdisk_id='',reservation_id='r-vfcgq5df',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-896359217',owner_user_name='tempest-DeleteServersTestJSON-896359217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:17:21Z,user_data=None,user_id='ecc78ceda36b43fc91a920894e5228a4',uuid=c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "address": "fa:16:3e:b4:11:7c", "network": {"id": "00a603e3-db94-4fd7-b030-afd4420ba72a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-164747889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d64a18a74e140f0bd504f507af25d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cef59c-80", "ovs_interfaceid": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Converting VIF {"id": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "address": "fa:16:3e:b4:11:7c", "network": {"id": "00a603e3-db94-4fd7-b030-afd4420ba72a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-164747889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d64a18a74e140f0bd504f507af25d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cef59c-80", "ovs_interfaceid": "02cef59c-80d7-4bcf-8882-a735ddfcdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=02cef59c-80d7-4bcf-8882-a735ddfcdfe3,network=Network(00a603e3-db94-4fd7-b030-afd4420ba72a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cef59c-80') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_vif [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=02cef59c-80d7-4bcf-8882-a735ddfcdfe3,network=Network(00a603e3-db94-4fd7-b030-afd4420ba72a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cef59c-80') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02cef59c-80, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=faef48f3-91d0-4736-a5d2-198ce209a146) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:08 user nova-compute[74658]: INFO os_vif [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=02cef59c-80d7-4bcf-8882-a735ddfcdfe3,network=Network(00a603e3-db94-4fd7-b030-afd4420ba72a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cef59c-80')
Nov 16 15:19:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzKDbMEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:08 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b588b4c4-3cb2-4625-b03f-4e35aa353c31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:19:08 user nova-compute[74658]: No targets found.
Nov 16 15:19:08 user nova-compute[74658]: iSNS:
Nov 16 15:19:08 user nova-compute[74658]: No targets found.
Nov 16 15:19:08 user nova-compute[74658]: STATIC:
Nov 16 15:19:08 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba
Nov 16 15:19:08 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:08 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:08 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0
Nov 16 15:19:08 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:08 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:08 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2
Nov 16 15:19:08 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:08 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:08 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4
Nov 16 15:19:08 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:08 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:08 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:19:08 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:08 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:08 user nova-compute[74658]: FIRMWARE:
Nov 16 15:19:08 user nova-compute[74658]: No targets found.
Nov 16 15:19:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:19:08 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:19:08 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c846fbea-64e7-49e7-a83c-b48f0799122c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5301f9-40a7-41fb-8ff7-fe83803dfc2a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:08 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:08 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:08 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:08 user nova-compute[74658]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 (non-flash)
Nov 16 15:19:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:08 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:08 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:08 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:08 user nova-compute[74658]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 (non-flash)
Nov 16 15:19:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07106309d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2'): ({'sdf'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Removing single pathed devices sdf {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2721475-e3fa-4294-8653-afb678140558]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c6eaa9-105f-4c95-8768-49000901a9f5]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Flushing IO for device /dev/sdf {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c755ec6-b4c2-449e-bd58-195a1c44ab4d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:19:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f481b7-36b7-46f0-9458-6d070011faaf]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] SCSI volumes sdf have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f522f7-2d48-4b5c-a650-38c338b12bac]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc69576-a18c-426b-9c9f-6b387283d79a]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2, portal: 172.16.0.220,3260]
Nov 16 15:19:09 user nova-compute[74658]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561dfed6-9424-4d0a-84ce-39ea50f19bc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[712d1356-5ab3-4777-b87f-0400a21f01ac]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] <== disconnect_volume: return (305ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:19:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Deleting instance files /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37_del
Nov 16 15:19:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Deletion of /opt/stack/data/nova/instances/c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37_del complete
Nov 16 15:19:09 user nova-compute[74658]: INFO nova.compute.manager [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 16 15:19:09 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:19:09 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:09 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Took 0.52 seconds to deallocate network for instance.
Nov 16 15:19:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-8c25d197-dc3c-4cb2-b801-f25fee450904 req-60486916-8f40-4996-9cc6-ea10cf52eccc service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Received event network-vif-plugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8c25d197-dc3c-4cb2-b801-f25fee450904 req-60486916-8f40-4996-9cc6-ea10cf52eccc service nova] Acquiring lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8c25d197-dc3c-4cb2-b801-f25fee450904 req-60486916-8f40-4996-9cc6-ea10cf52eccc service nova] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8c25d197-dc3c-4cb2-b801-f25fee450904 req-60486916-8f40-4996-9cc6-ea10cf52eccc service nova] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-8c25d197-dc3c-4cb2-b801-f25fee450904 req-60486916-8f40-4996-9cc6-ea10cf52eccc service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] No waiting events found dispatching network-vif-plugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:10 user nova-compute[74658]: WARNING nova.compute.manager [req-8c25d197-dc3c-4cb2-b801-f25fee450904 req-60486916-8f40-4996-9cc6-ea10cf52eccc service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Received unexpected event network-vif-plugged-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 for instance with vm_state active and task_state deleting.
Nov 16 15:19:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-8c25d197-dc3c-4cb2-b801-f25fee450904 req-60486916-8f40-4996-9cc6-ea10cf52eccc service nova] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Received event network-vif-deleted-02cef59c-80d7-4bcf-8882-a735ddfcdfe3 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:10 user nova-compute[74658]: INFO nova.compute.manager [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] [instance: c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37] Took 0.86 seconds to detach 1 volumes for instance.
Nov 16 15:19:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:10 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:19:10 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:19:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:10 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Deleted allocations for instance c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37
Nov 16 15:19:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6766c37f-20cb-4dd0-9861-5a726fb4e115 tempest-DeleteServersTestJSON-896359217 tempest-DeleteServersTestJSON-896359217-project-member] Lock "c9347f2a-3e10-48cd-8bc8-8ba2a4e0ae37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.232s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-8ee04a2f-0c7f-43b4-b822-fcd4e05e2dc0 req-27e9014d-f904-422b-bc40-fa3785e2b7db service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Received event network-changed-cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-8ee04a2f-0c7f-43b4-b822-fcd4e05e2dc0 req-27e9014d-f904-422b-bc40-fa3785e2b7db service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Refreshing instance network info cache due to event network-changed-cd4edd24-4702-4a79-af81-025dc029758b. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:19:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8ee04a2f-0c7f-43b4-b822-fcd4e05e2dc0 req-27e9014d-f904-422b-bc40-fa3785e2b7db service nova] Acquiring lock "refresh_cache-ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:19:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8ee04a2f-0c7f-43b4-b822-fcd4e05e2dc0 req-27e9014d-f904-422b-bc40-fa3785e2b7db service nova] Acquired lock "refresh_cache-ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:19:20 user nova-compute[74658]: DEBUG nova.network.neutron [req-8ee04a2f-0c7f-43b4-b822-fcd4e05e2dc0 req-27e9014d-f904-422b-bc40-fa3785e2b7db service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Refreshing network info cache for port cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:19:20 user nova-compute[74658]: DEBUG nova.network.neutron [req-8ee04a2f-0c7f-43b4-b822-fcd4e05e2dc0 req-27e9014d-f904-422b-bc40-fa3785e2b7db service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Updated VIF entry in instance network info cache for port cd4edd24-4702-4a79-af81-025dc029758b. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:19:20 user nova-compute[74658]: DEBUG nova.network.neutron [req-8ee04a2f-0c7f-43b4-b822-fcd4e05e2dc0 req-27e9014d-f904-422b-bc40-fa3785e2b7db service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Updating instance_info_cache with network_info: [{"id": "cd4edd24-4702-4a79-af81-025dc029758b", "address": "fa:16:3e:f1:2a:ca", "network": {"id": "4782d17a-7d24-40e4-8098-22b2ea2b6a31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1120804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8383a2cd0549d999afd14c6e8f373b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4edd24-47", "ovs_interfaceid": "cd4edd24-4702-4a79-af81-025dc029758b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8ee04a2f-0c7f-43b4-b822-fcd4e05e2dc0 req-27e9014d-f904-422b-bc40-fa3785e2b7db service nova] Releasing lock "refresh_cache-ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:19:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:21 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lazy-loading 'flavor' on Instance uuid ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:22 user nova-compute[74658]: INFO nova.compute.manager [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Attaching volume d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 to /dev/sdc
Nov 16 15:19:22 user nova-compute[74658]: DEBUG os_brick.utils [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d95fa41-4a7e-4b1d-af81-b6d666b33491]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab16d87-fb0f-434e-b3f7-1c09ef05f94d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a7f79a-6dff-4f11-92d8-3de75ed509ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bab4da2-b458-45b6-b7a2-e502c7238a1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:22 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:19:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c860cec7-832f-4804-bf08-256db4d1aa40]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG os_brick.utils [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:22 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Updating existing volume attachment record: 5ff1aa55-1193-48a9-9c1b-3d78627164df {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:19:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-d3536df9-3eee-486b-b85c-6541f87b43d4 req-18c64a6d-f2ae-48e6-b003-ef6f73b85469 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-changed-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-d3536df9-3eee-486b-b85c-6541f87b43d4 req-18c64a6d-f2ae-48e6-b003-ef6f73b85469 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Refreshing instance network info cache due to event network-changed-64c01998-6dfe-48d7-8e96-baf6a9cce100. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:19:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d3536df9-3eee-486b-b85c-6541f87b43d4 req-18c64a6d-f2ae-48e6-b003-ef6f73b85469 service nova] Acquiring lock "refresh_cache-d497d108-2eb4-448d-9d1f-e8864e0b48a4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:19:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d3536df9-3eee-486b-b85c-6541f87b43d4 req-18c64a6d-f2ae-48e6-b003-ef6f73b85469 service nova] Acquired lock "refresh_cache-d497d108-2eb4-448d-9d1f-e8864e0b48a4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:19:23 user nova-compute[74658]: DEBUG nova.network.neutron [req-d3536df9-3eee-486b-b85c-6541f87b43d4 req-18c64a6d-f2ae-48e6-b003-ef6f73b85469 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Refreshing network info cache for port 64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:19:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:23 user nova-compute[74658]: DEBUG nova.network.neutron [req-d3536df9-3eee-486b-b85c-6541f87b43d4 req-18c64a6d-f2ae-48e6-b003-ef6f73b85469 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Updated VIF entry in instance network info cache for port 64c01998-6dfe-48d7-8e96-baf6a9cce100. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:19:23 user nova-compute[74658]: DEBUG nova.network.neutron [req-d3536df9-3eee-486b-b85c-6541f87b43d4 req-18c64a6d-f2ae-48e6-b003-ef6f73b85469 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Updating instance_info_cache with network_info: [{"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d3536df9-3eee-486b-b85c-6541f87b43d4 req-18c64a6d-f2ae-48e6-b003-ef6f73b85469 service nova] Releasing lock "refresh_cache-d497d108-2eb4-448d-9d1f-e8864e0b48a4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:19:24 user nova-compute[74658]: INFO nova.compute.manager [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Rebuilding instance
Nov 16 15:19:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:19:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-11cbc262-c27f-4cd1-92c9-8eea3da02818 req-86735c3e-2129-45d3-b87a-b0738cdc07e1 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-vif-unplugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-11cbc262-c27f-4cd1-92c9-8eea3da02818 req-86735c3e-2129-45d3-b87a-b0738cdc07e1 service nova] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-11cbc262-c27f-4cd1-92c9-8eea3da02818 req-86735c3e-2129-45d3-b87a-b0738cdc07e1 service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-11cbc262-c27f-4cd1-92c9-8eea3da02818 req-86735c3e-2129-45d3-b87a-b0738cdc07e1 service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-11cbc262-c27f-4cd1-92c9-8eea3da02818 req-86735c3e-2129-45d3-b87a-b0738cdc07e1 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] No waiting events found dispatching network-vif-unplugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:25 user nova-compute[74658]: WARNING nova.compute.manager [req-11cbc262-c27f-4cd1-92c9-8eea3da02818 req-86735c3e-2129-45d3-b87a-b0738cdc07e1 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received unexpected event network-vif-unplugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 for instance with vm_state active and task_state rebuilding.
Nov 16 15:19:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Instance destroyed successfully.
Nov 16 15:19:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Instance destroyed successfully.
Nov 16 15:19:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1774448289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-950433439',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkap0gRNcurWDfCcy7qt804/okYphbvtBgQJOzKxESAFGAYHBwlIXmSq28wC/by2fh2JpmwGxBO4odLx6IdBKSumHSyV2ncRWbtbwWfg4j7iPSMFgyo5c1IQ1GaeCy8NQ==',key_name='tempest-keypair-790246539',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34629163159f48e5a7e45cc79cd11abb',ramdisk_id='',reservation_id='r-rlllv1i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-912489320',owner_user_name='tempest-ServerActionsV293TestJSON-912489320-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:19:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='112ea992e8a5439d80ab8032c5f4074d',uuid=d497d108-2eb4-448d-9d1f-e8864e0b48a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converting VIF {"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_vif [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64c01998-6d, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4a3d64a-7188-4f10-8109-6095a29bf8c0) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:25 user nova-compute[74658]: INFO os_vif [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d')
Nov 16 15:19:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRGUKVeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:25 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b150adca-2424-4c1b-b8d1-d1b48d19a686]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:19:25 user nova-compute[74658]: No targets found.
Nov 16 15:19:25 user nova-compute[74658]: iSNS:
Nov 16 15:19:25 user nova-compute[74658]: No targets found.
Nov 16 15:19:25 user nova-compute[74658]: STATIC:
Nov 16 15:19:25 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba
Nov 16 15:19:25 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:25 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:25 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0
Nov 16 15:19:25 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:25 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:25 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4
Nov 16 15:19:25 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:25 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:25 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:19:25 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:25 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:25 user nova-compute[74658]: FIRMWARE:
Nov 16 15:19:25 user nova-compute[74658]: No targets found.
Nov 16 15:19:25 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:19:25 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:19:25 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3148db8c-0679-48a5-a256-7c61c7f80edc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46eee15-e060-4c82-b888-d6f2c0889f5f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:25 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:25 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:25 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:25 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:25 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:25 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:25 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:25 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0733dbd090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c42dd6-d3c6-41eb-a636-3e29a253a9e0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9651f5a-6f01-4396-a6c2-2d218db40add]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b802b40a-7100-4bcc-8b63-42a7cf9b6f8a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6d1a4f-abf8-475a-a73b-2f00a5f7b6cd]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO72dc17f6-3f394657261f2535', '/dev/disk/by-id/scsi-23366333934363537', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_72dc17f6') {{(pid=84815) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceb7387-0744-414b-9ac6-5e0ec756c23e]: (4, None) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[846f21f1-9072-44d4-b18d-4abf9e21f245]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c184a7-e869-46e2-ab04-540cd8298c4f]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260]
Nov 16 15:19:25 user nova-compute[74658]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:25 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67e354d-e649-4f0d-9e10-0b09e9084426]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] <== disconnect_volume: return (335ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:19:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Deleting instance files /opt/stack/data/nova/instances/d497d108-2eb4-448d-9d1f-e8864e0b48a4_del
Nov 16 15:19:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Deletion of /opt/stack/data/nova/instances/d497d108-2eb4-448d-9d1f-e8864e0b48a4_del complete
Nov 16 15:19:26 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance d497d108-2eb4-448d-9d1f-e8864e0b48a4 could not be found.
Nov 16 15:19:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRGUKVeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:26 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411e789-943a-4e9d-b4ee-fe245777ecc6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:19:26 user nova-compute[74658]: No targets found.
Nov 16 15:19:26 user nova-compute[74658]: iSNS:
Nov 16 15:19:26 user nova-compute[74658]: No targets found.
Nov 16 15:19:26 user nova-compute[74658]: STATIC:
Nov 16 15:19:26 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba
Nov 16 15:19:26 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:26 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:26 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0
Nov 16 15:19:26 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:26 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:26 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4
Nov 16 15:19:26 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:26 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:26 user nova-compute[74658]: FIRMWARE:
Nov 16 15:19:26 user nova-compute[74658]: No targets found.
Nov 16 15:19:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:19:26 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:19:26 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26ea6b6-0fd9-4cfe-97fc-8625f7b8f25a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[99398cc1-15e0-448f-8b1c-fdcb8ca69180]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:26 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:26 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:26 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:26 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07301f23b0>, {}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Disconnecting from: [] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] <== disconnect_volume: return (82ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-cea97908-79ed-45b7-bbe5-8f055835d13f req-1b169715-a2ca-42af-8807-d4095fbd7dc0 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Received event network-changed-1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-cea97908-79ed-45b7-bbe5-8f055835d13f req-1b169715-a2ca-42af-8807-d4095fbd7dc0 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Refreshing instance network info cache due to event network-changed-1772b72e-f08e-4494-8023-b54d65490e21. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cea97908-79ed-45b7-bbe5-8f055835d13f req-1b169715-a2ca-42af-8807-d4095fbd7dc0 service nova] Acquiring lock "refresh_cache-11bd9639-1c9e-4080-bd89-bf34724684d5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cea97908-79ed-45b7-bbe5-8f055835d13f req-1b169715-a2ca-42af-8807-d4095fbd7dc0 service nova] Acquired lock "refresh_cache-11bd9639-1c9e-4080-bd89-bf34724684d5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG nova.network.neutron [req-cea97908-79ed-45b7-bbe5-8f055835d13f req-1b169715-a2ca-42af-8807-d4095fbd7dc0 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Refreshing network info cache for port 1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lazy-loading 'flavor' on Instance uuid 11bd9639-1c9e-4080-bd89-bf34724684d5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Preparing to wait for external event volume-reimaged-c0b36d65-b871-4dbe-88b0-eea4eae50d29 {{(pid=74658) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG nova.network.neutron [req-cea97908-79ed-45b7-bbe5-8f055835d13f req-1b169715-a2ca-42af-8807-d4095fbd7dc0 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Updated VIF entry in instance network info cache for port 1772b72e-f08e-4494-8023-b54d65490e21. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG nova.network.neutron [req-cea97908-79ed-45b7-bbe5-8f055835d13f req-1b169715-a2ca-42af-8807-d4095fbd7dc0 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Updating instance_info_cache with network_info: [{"id": "1772b72e-f08e-4494-8023-b54d65490e21", "address": "fa:16:3e:c9:8d:a0", "network": {"id": "10b7ee2b-413e-4661-a24c-632afd5beae1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1561286324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f1b74d765ef4353b10308124094030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772b72e-f0", "ovs_interfaceid": "1772b72e-f08e-4494-8023-b54d65490e21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cea97908-79ed-45b7-bbe5-8f055835d13f req-1b169715-a2ca-42af-8807-d4095fbd7dc0 service nova] Releasing lock "refresh_cache-11bd9639-1c9e-4080-bd89-bf34724684d5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG nova.compute.manager [req-9ce96fb0-40fc-436f-ae9b-84d2f03617d1 req-481dd281-4b0b-4ae0-8a44-7b45036ba9f5 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9ce96fb0-40fc-436f-ae9b-84d2f03617d1 req-481dd281-4b0b-4ae0-8a44-7b45036ba9f5 service nova] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9ce96fb0-40fc-436f-ae9b-84d2f03617d1 req-481dd281-4b0b-4ae0-8a44-7b45036ba9f5 service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9ce96fb0-40fc-436f-ae9b-84d2f03617d1 req-481dd281-4b0b-4ae0-8a44-7b45036ba9f5 service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG nova.compute.manager [req-9ce96fb0-40fc-436f-ae9b-84d2f03617d1 req-481dd281-4b0b-4ae0-8a44-7b45036ba9f5 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] No event matching network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 in dict_keys([('volume-reimaged', 'c0b36d65-b871-4dbe-88b0-eea4eae50d29')]) {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 16 15:19:27 user nova-compute[74658]: WARNING nova.compute.manager [req-9ce96fb0-40fc-436f-ae9b-84d2f03617d1 req-481dd281-4b0b-4ae0-8a44-7b45036ba9f5 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received unexpected event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 for instance with vm_state active and task_state rebuilding.
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:27 user nova-compute[74658]: INFO nova.compute.manager [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Attaching volume 5fdbb33e-2491-44e7-a44a-deb930f43480 to /dev/vdb
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.utils [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce2c4db-ce83-4b10-b60f-b97fccdfef61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d76aa1-77c0-43ef-9fcb-592f1e19cd36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9d32ac-c023-4a84-986e-c9c420d06c4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41ab13f-07a3-4fab-be69-483837a3deaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxKpHlbt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:27 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:27 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:27 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:27 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc2588f-f1d9-4cb9-a947-32691305f82b]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.utils [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Updating existing volume attachment record: bd895817-67b2-4bb8-a147-acaa47772e4d {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bd7374-ba1a-4441-831f-15063f634fe9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:19:27 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dd990d-2ac7-4e73-9092-b84ebadbc705]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123] added
Nov 16 15:19:27 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5ea5dc-2088-4b85-ad2c-3ad57b03ea5f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5ec265-79e9-4457-ab3f-f3ea76ef5046]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxKpHlbt {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxKpHlbt" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[573ad921-b086-4801-8865-bff5b1dafacb]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OxKpHlbt'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2966f75-6bf1-4049-8ce0-1d67c49d68d7]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8983108c-dfb1-43d5-b7d1-58f60b895275]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:27 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:27 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:27 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:27 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:27 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:27 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb4b08a-213f-47f6-b8d2-1627ffa503c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123, portal: 172.16.0.220,3260]
Nov 16 15:19:27 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:27 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b95d65a-3cc8-4787-b434-1bfdbe8bce6f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[614f3f2b-621f-4275-a970-ff9d9eb3fdb2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:27 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:27 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:27 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:27 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:27 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:27 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:27 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:27 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[28922914-b549-42a5-8f5b-58994ce7eea6]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:19:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxKpHlbt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:19:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23833333632393264', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833333632393264', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:19:28 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lazy-loading 'flavor' on Instance uuid ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:19:28 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:28 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:19:28 user nova-compute[74658]:   <target dev="sdc" bus="scsi"/>
Nov 16 15:19:28 user nova-compute[74658]:   <serial>d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123</serial>
Nov 16 15:19:28 user nova-compute[74658]:   <address type="drive" controller="0" unit="2"/>
Nov 16 15:19:28 user nova-compute[74658]: </disk>
Nov 16 15:19:28 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:19:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] No BDM found with device name sda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] No VIF found with MAC fa:16:3e:f1:2a:ca, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:19:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8d2ea92b-a219-47af-a984-f2b14d8369f1 tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.336s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-bdd27070-aeb7-4ce9-9d5b-679f7267a3c1 req-f8825c30-d07b-4fd2-9503-7b71f5f5a269 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Received event network-changed-2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-bdd27070-aeb7-4ce9-9d5b-679f7267a3c1 req-f8825c30-d07b-4fd2-9503-7b71f5f5a269 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Refreshing instance network info cache due to event network-changed-2f8f9aea-261c-4e66-a187-93378644d1eb. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:19:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bdd27070-aeb7-4ce9-9d5b-679f7267a3c1 req-f8825c30-d07b-4fd2-9503-7b71f5f5a269 service nova] Acquiring lock "refresh_cache-a2f77c43-8afd-465a-bb09-537cc3c6461d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:19:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bdd27070-aeb7-4ce9-9d5b-679f7267a3c1 req-f8825c30-d07b-4fd2-9503-7b71f5f5a269 service nova] Acquired lock "refresh_cache-a2f77c43-8afd-465a-bb09-537cc3c6461d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:19:29 user nova-compute[74658]: DEBUG nova.network.neutron [req-bdd27070-aeb7-4ce9-9d5b-679f7267a3c1 req-f8825c30-d07b-4fd2-9503-7b71f5f5a269 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Refreshing network info cache for port 2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:30 user nova-compute[74658]: INFO nova.compute.manager [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Detaching volume d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123
Nov 16 15:19:30 user nova-compute[74658]: INFO nova.virt.block_device [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Attempting to driver detach volume d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 from mountpoint /dev/sdc
Nov 16 15:19:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Attempting to detach device sdc from instance ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:19:30 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:30 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:19:30 user nova-compute[74658]:   <target dev="sdc" bus="scsi"/>
Nov 16 15:19:30 user nova-compute[74658]:   <serial>d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123</serial>
Nov 16 15:19:30 user nova-compute[74658]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 15:19:30 user nova-compute[74658]: </disk>
Nov 16 15:19:30 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:19:30 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Successfully detached device sdc from instance ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 from the persistent domain config.
Nov 16 15:19:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:19:30 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:30 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:19:30 user nova-compute[74658]:   <target dev="sdc" bus="scsi"/>
Nov 16 15:19:30 user nova-compute[74658]:   <serial>d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123</serial>
Nov 16 15:19:30 user nova-compute[74658]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 15:19:30 user nova-compute[74658]: </disk>
Nov 16 15:19:30 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Acquiring lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG nova.objects.instance [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lazy-loading 'flavor' on Instance uuid a2f77c43-8afd-465a-bb09-537cc3c6461d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG nova.network.neutron [req-bdd27070-aeb7-4ce9-9d5b-679f7267a3c1 req-f8825c30-d07b-4fd2-9503-7b71f5f5a269 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Updated VIF entry in instance network info cache for port 2f8f9aea-261c-4e66-a187-93378644d1eb. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG nova.network.neutron [req-bdd27070-aeb7-4ce9-9d5b-679f7267a3c1 req-f8825c30-d07b-4fd2-9503-7b71f5f5a269 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Updating instance_info_cache with network_info: [{"id": "2f8f9aea-261c-4e66-a187-93378644d1eb", "address": "fa:16:3e:0e:8b:db", "network": {"id": "c4338e19-e8b4-4395-8709-98a16689c81e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688938605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "178e7561b73544a284db0720f88a0fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8f9aea-26", "ovs_interfaceid": "2f8f9aea-261c-4e66-a187-93378644d1eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bdd27070-aeb7-4ce9-9d5b-679f7267a3c1 req-f8825c30-d07b-4fd2-9503-7b71f5f5a269 service nova] Releasing lock "refresh_cache-a2f77c43-8afd-465a-bb09-537cc3c6461d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Acquiring lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:30 user nova-compute[74658]: INFO nova.compute.manager [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Attaching volume e34c2238-b543-4c0c-96ba-6a408244d70c to /dev/vdb
Nov 16 15:19:30 user nova-compute[74658]: DEBUG os_brick.utils [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[168ee9fe-d182-4b94-8a60-e6bbbb7fb131]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccca1c3-9813-4083-983f-5f9d9a0baa24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d5821d-c7e2-4f3c-9e0b-519cb5b8ed12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1042ce66-d6e6-4a9f-a8dc-3fd8dab0dc7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:30 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:19:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[767fccef-27ee-48ee-8cda-183ea29b434f]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG os_brick.utils [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:30 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Updating existing volume attachment record: 5ca78b58-c01c-477a-9beb-21649b724799 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:19:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:31 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lazy-loading 'flavor' on Instance uuid 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:31 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Ignoring supplied device name: /dev/vdb
Nov 16 15:19:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:31 user nova-compute[74658]: INFO nova.compute.manager [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Attaching volume 6015d269-89f9-4107-9609-59bf546595ea to /dev/vdb
Nov 16 15:19:31 user nova-compute[74658]: DEBUG os_brick.utils [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-d7288261-f523-4225-afc0-388dd15b349b req-d662485a-ae1e-4fb1-b8d5-13ef8b94b948 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Received event network-changed-555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-d7288261-f523-4225-afc0-388dd15b349b req-d662485a-ae1e-4fb1-b8d5-13ef8b94b948 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Refreshing instance network info cache due to event network-changed-555621d9-35a8-43e8-9f3c-6c829a7fcdbe. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:19:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d7288261-f523-4225-afc0-388dd15b349b req-d662485a-ae1e-4fb1-b8d5-13ef8b94b948 service nova] Acquiring lock "refresh_cache-16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:19:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d7288261-f523-4225-afc0-388dd15b349b req-d662485a-ae1e-4fb1-b8d5-13ef8b94b948 service nova] Acquired lock "refresh_cache-16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:19:31 user nova-compute[74658]: DEBUG nova.network.neutron [req-d7288261-f523-4225-afc0-388dd15b349b req-d662485a-ae1e-4fb1-b8d5-13ef8b94b948 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Refreshing network info cache for port 555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bc3dac-e135-4962-bf01-1663583ebca9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b5854b-d4c7-46e6-a1b6-341e1a06b54c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[57550c2e-5aec-406c-8b2d-846ee91ccbfa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f706b29d-612c-49d1-8976-6192a385ba92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:32 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe1a877-1af7-43b3-ad21-367740e5d4ac]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG os_brick.utils [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Updating existing volume attachment record: 8955738d-e7d1-42ef-8f52-480efe04a775 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG nova.network.neutron [req-d7288261-f523-4225-afc0-388dd15b349b req-d662485a-ae1e-4fb1-b8d5-13ef8b94b948 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Updated VIF entry in instance network info cache for port 555621d9-35a8-43e8-9f3c-6c829a7fcdbe. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG nova.network.neutron [req-d7288261-f523-4225-afc0-388dd15b349b req-d662485a-ae1e-4fb1-b8d5-13ef8b94b948 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Updating instance_info_cache with network_info: [{"id": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "address": "fa:16:3e:fc:a7:b2", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555621d9-35", "ovs_interfaceid": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d7288261-f523-4225-afc0-388dd15b349b req-d662485a-ae1e-4fb1-b8d5-13ef8b94b948 service nova] Releasing lock "refresh_cache-16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:19:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBpxUvXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:37 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:37 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:37 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f377f6-2f0c-4f9e-be80-3c0dafff970f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:19:37 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[43af56c1-b439-4cdc-bb2e-048a8dbb0165]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480] added
Nov 16 15:19:37 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[900b6d9f-ae52-49f2-ae6c-b157e7caeab3]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[611614f9-dda2-4bbe-96df-3f83db07b885]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eBpxUvXH {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eBpxUvXH" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d201f8-d11e-476b-a549-440ef6d890fa]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eBpxUvXH'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[154e666c-858b-43fc-8118-bbadf3f17828]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35a84ef-0971-4050-add4-be0ab7381640]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[363af136-0b49-444c-afdf-7d94cd5ef9ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260]
Nov 16 15:19:38 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ab4794-2f8e-482c-a026-ad19e8241717]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bdbc8a-0145-4021-9e02-f4083af679d3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b419c-2a88-4385-9f24-fa41a682408b]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBpxUvXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBHJKqQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:38 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgjGUWvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:38 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26634393432333834', 'path': '/dev/sdg'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634393432333834', 'path': '/dev/sdg'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.926s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:39 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:39 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lazy-loading 'flavor' on Instance uuid 11bd9639-1c9e-4080-bd89-bf34724684d5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f4b437-44bc-449a-a2fe-79aaeb90d48c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:19:39 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:19:39 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:39 user nova-compute[74658]:   <source dev="/dev/sdg"/>
Nov 16 15:19:39 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:19:39 user nova-compute[74658]:   <serial>5fdbb33e-2491-44e7-a44a-deb930f43480</serial>
Nov 16 15:19:39 user nova-compute[74658]: </disk>
Nov 16 15:19:39 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[88569255-9657-468a-a341-e9a46085b159]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c] added
Nov 16 15:19:39 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c20e6d2-f03b-4154-9b45-b492c77ff0f5]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea1fcfd-ca6c-4c8f-b8de-1aa000d4e74c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aBHJKqQe {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aBHJKqQe" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2fbb4f-879d-4afe-86fd-2121f2d7fe5e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aBHJKqQe'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b753d82d-0a48-4ed1-97bf-f7ee22f24ee1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eca5ce3-3aaf-4955-ad6d-8c0449da087a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc18a065-84d3-4a6e-86a8-34e610583d6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c, portal: 172.16.0.220,3260]
Nov 16 15:19:39 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:39 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b677f2b-9038-448a-8f00-8e7cefada2b3]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b36a62a-18c2-4592-b533-3e09ac8d37cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:39 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c43a0d9-a527-4d16-8447-5058f35f9306]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBHJKqQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] No VIF found with MAC fa:16:3e:c9:8d:a0, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b6c8e570-a1cd-40f2-b647-cd63541426f6 tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.617s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] <== connect_volume: return (2261ms) {'type': 'block', 'scsi_wwn': '26639653361393431', 'path': '/dev/sdh'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639653361393431', 'path': '/dev/sdh'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.986s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:40 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:40 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG nova.objects.instance [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lazy-loading 'flavor' on Instance uuid a2f77c43-8afd-465a-bb09-537cc3c6461d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15686ed-c605-43ca-915b-f192f868df24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:19:40 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae9b246-a087-4ec0-be31-fc2fcf2d9380]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea] added
Nov 16 15:19:40 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] attach device xml: <disk type="block" device="disk">
Nov 16 15:19:40 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:40 user nova-compute[74658]:   <source dev="/dev/sdh"/>
Nov 16 15:19:40 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:19:40 user nova-compute[74658]:   <serial>e34c2238-b543-4c0c-96ba-6a408244d70c</serial>
Nov 16 15:19:40 user nova-compute[74658]: </disk>
Nov 16 15:19:40 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e296e08-0bb5-429b-a2de-3b204cffdb7c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[768efc1e-caba-46b2-aa3f-154cf7680f85]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgjGUWvB {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgjGUWvB" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00b9750-bd1e-4a14-be9c-23474ddb3847]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OgjGUWvB'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc67217-38f1-408d-8aa4-f7220970f90b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d061d16-9be0-4161-bdcb-1b0b8bf275e1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:40 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:40 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:40 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:40 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:40 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:40 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:40 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:40 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:40 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:40 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:40 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:40 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG os_brick.utils [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff49fdd2-5f20-4abb-b843-c1564ddae334]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba062e-4ed6-4915-84bd-a83d899b8da6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad61a9d-9dad-4f68-9484-ff39520d0622]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d75d04-5dab-4e0f-b00e-e9dcd5dad059]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:41 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f84fab9-33af-468c-aa99-3e6d6966a443]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.utils [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --login" returned: 0 in 0.324s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[869fc3ae-2ea6-4ca8-9fe2-107d5460a4c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea, portal: 172.16.0.220,3260]
Nov 16 15:19:41 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.067s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[851e4c0b-d30e-437c-b0d8-bf7904c59914]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d7c3cc-d659-4c74-a231-253c681ee747]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:41 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.632s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:19:41 user nova-compute[74658]: INFO nova.compute.manager [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Swapping volume 5fdbb33e-2491-44e7-a44a-deb930f43480 for 15439dd8-bb51-4dc9-977f-08bfe205a586
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.200s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0183fbd-16d7-4fcb-ac02-0f832fd64975]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgjGUWvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] No VIF found with MAC fa:16:3e:0e:8b:db, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:19:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-238de99d-cb17-4ba0-b08e-ff51c18c1e29 tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.033s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-5626036c-63fc-498d-840b-fd6fd7d61ab1 req-8a57de07-0d32-4e1d-aa8c-83f6b77f76a1 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event volume-reimaged-c0b36d65-b871-4dbe-88b0-eea4eae50d29 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5626036c-63fc-498d-840b-fd6fd7d61ab1 req-8a57de07-0d32-4e1d-aa8c-83f6b77f76a1 service nova] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5626036c-63fc-498d-840b-fd6fd7d61ab1 req-8a57de07-0d32-4e1d-aa8c-83f6b77f76a1 service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5626036c-63fc-498d-840b-fd6fd7d61ab1 req-8a57de07-0d32-4e1d-aa8c-83f6b77f76a1 service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-5626036c-63fc-498d-840b-fd6fd7d61ab1 req-8a57de07-0d32-4e1d-aa8c-83f6b77f76a1 service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Processing event volume-reimaged-c0b36d65-b871-4dbe-88b0-eea4eae50d29 {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:19:42 user nova-compute[74658]: INFO nova.virt.block_device [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Booting with volume c0b36d65-b871-4dbe-88b0-eea4eae50d29 at /dev/vda
Nov 16 15:19:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.853s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] <== connect_volume: return (3839ms) {'type': 'block', 'scsi_wwn': '23662626438343833', 'path': '/dev/sdf'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662626438343833', 'path': '/dev/sdf'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG os_brick.utils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lazy-loading 'flavor' on Instance uuid 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f625cb-921d-483d-adb1-1a9bd2324161]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:19:42 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:42 user nova-compute[74658]:   <source dev="/dev/sdf"/>
Nov 16 15:19:42 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:19:42 user nova-compute[74658]:   <serial>6015d269-89f9-4107-9609-59bf546595ea</serial>
Nov 16 15:19:42 user nova-compute[74658]: </disk>
Nov 16 15:19:42 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[773356ee-f771-426b-b48b-06a00bcc5c82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ed692c-2069-4b31-b8d2-d6d55d71051c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[339e146b-accf-44f7-8789-8c91b9b8d179]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:42 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd3dd12-aa1f-4089-957e-6bcb2be4ab5d]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG os_brick.utils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Updating existing volume attachment record: 9ee56c2a-adcb-465d-bf30-7fd1e4bcda0e {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-87178ed3-45e2-4eba-95fb-495e9ff8d669 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] volume_snapshot_create: create_info: {'snapshot_id': 'b858b008-2291-4542-afec-d52167becdcb', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74658) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-87178ed3-45e2-4eba-95fb-495e9ff8d669 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] snap xml: <domainsnapshot>
Nov 16 15:19:42 user nova-compute[74658]:   <disks>
Nov 16 15:19:42 user nova-compute[74658]:     <disk name="/dev/sdh" snapshot="external" type="file">
Nov 16 15:19:42 user nova-compute[74658]:       <source file="/dev/new_file"/>
Nov 16 15:19:42 user nova-compute[74658]:     </disk>
Nov 16 15:19:42 user nova-compute[74658]:     <disk name="vda" snapshot="no"/>
Nov 16 15:19:42 user nova-compute[74658]:   </disks>
Nov 16 15:19:42 user nova-compute[74658]: </domainsnapshot>
Nov 16 15:19:42 user nova-compute[74658]:  {{(pid=74658) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.objects.instance [None req-87178ed3-45e2-4eba-95fb-495e9ff8d669 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] Lazy-loading 'system_metadata' on Instance uuid a2f77c43-8afd-465a-bb09-537cc3c6461d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c6f65643-a5ea-4a58-8c99-72649b1f8185 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] volume_snapshot_delete: delete_info: {'volume_id': 'e34c2238-b543-4c0c-96ba-6a408244d70c'} {{(pid=74658) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [None req-c6f65643-a5ea-4a58-8c99-72649b1f8185 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Traceback (most recent call last):
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     if delete_info['type'] != 'qcow2':
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] KeyError: 'type'
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] 
Nov 16 15:19:42 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-87178ed3-45e2-4eba-95fb-495e9ff8d669 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [None req-87178ed3-45e2-4eba-95fb-495e9ff8d669 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Traceback (most recent call last):
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     rv = execute(f, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     six.reraise(c, e, tb)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     raise value
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     rv = meth(*args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] 
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [None req-87178ed3-45e2-4eba-95fb-495e9ff8d669 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Traceback (most recent call last):
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     self._volume_snapshot_create(context, instance, guest,
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     rv = execute(f, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     six.reraise(c, e, tb)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     raise value
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     rv = meth(*args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] 
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [None req-c6f65643-a5ea-4a58-8c99-72649b1f8185 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver 
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver 
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-58f7d042-e56e-4a13-b03d-61f09e1ae40a)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver 
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver 
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver 
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server [None req-c6f65643-a5ea-4a58-8c99-72649b1f8185 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] Exception during message handling: KeyError: 'type'
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server 
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver [None req-87178ed3-45e2-4eba-95fb-495e9ff8d669 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b858b008-2291-4542-afec-d52167becdcb could not be found.
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     raise value
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver 
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver 
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b858b008-2291-4542-afec-d52167becdcb could not be found. (HTTP 404) (Request-ID: req-1ad5a702-93ab-4075-838c-31d7c7065cf4)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver 
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver 
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b858b008-2291-4542-afec-d52167becdcb could not be found.
Nov 16 15:19:42 user nova-compute[74658]: ERROR nova.virt.libvirt.driver 
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server [None req-87178ed3-45e2-4eba-95fb-495e9ff8d669 tempest-VolumesAssistedSnapshotsTest-1257118727 tempest-VolumesAssistedSnapshotsTest-1257118727-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     raise value
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 15:19:42 user nova-compute[74658]: ERROR oslo_messaging.rpc.server 
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] No VIF found with MAC fa:16:3e:fc:a7:b2, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:19:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8603b576-169e-4f63-b2af-fb70ae75d96a tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.091s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Acquiring lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:43 user nova-compute[74658]: INFO nova.compute.manager [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Detaching volume e34c2238-b543-4c0c-96ba-6a408244d70c
Nov 16 15:19:43 user nova-compute[74658]: INFO nova.virt.block_device [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Attempting to driver detach volume e34c2238-b543-4c0c-96ba-6a408244d70c from mountpoint /dev/vdb
Nov 16 15:19:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Attempting to detach device vdb from instance a2f77c43-8afd-465a-bb09-537cc3c6461d from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:19:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 15:19:43 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:43 user nova-compute[74658]:   <source dev="/dev/sdh"/>
Nov 16 15:19:43 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:19:43 user nova-compute[74658]:   <serial>e34c2238-b543-4c0c-96ba-6a408244d70c</serial>
Nov 16 15:19:43 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:19:43 user nova-compute[74658]: </disk>
Nov 16 15:19:43 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:19:43 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Successfully detached device vdb from instance a2f77c43-8afd-465a-bb09-537cc3c6461d from the persistent domain config.
Nov 16 15:19:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2f77c43-8afd-465a-bb09-537cc3c6461d from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:19:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 15:19:43 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:43 user nova-compute[74658]:   <source dev="/dev/sdh"/>
Nov 16 15:19:43 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:19:43 user nova-compute[74658]:   <serial>e34c2238-b543-4c0c-96ba-6a408244d70c</serial>
Nov 16 15:19:43 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:19:43 user nova-compute[74658]: </disk>
Nov 16 15:19:43 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:19:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2f77c43-8afd-465a-bb09-537cc3c6461d {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:19:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-92ada3e2-2a44-4f81-9921-9d9b903473ef req-31b9fbc1-1b67-4e10-adab-6c8489ab7680 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-changed-bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-92ada3e2-2a44-4f81-9921-9d9b903473ef req-31b9fbc1-1b67-4e10-adab-6c8489ab7680 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing instance network info cache due to event network-changed-bdddb146-3305-47a7-a523-d6430b3d2ced. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:19:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-92ada3e2-2a44-4f81-9921-9d9b903473ef req-31b9fbc1-1b67-4e10-adab-6c8489ab7680 service nova] Acquiring lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:19:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-92ada3e2-2a44-4f81-9921-9d9b903473ef req-31b9fbc1-1b67-4e10-adab-6c8489ab7680 service nova] Acquired lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:19:45 user nova-compute[74658]: DEBUG nova.network.neutron [req-92ada3e2-2a44-4f81-9921-9d9b903473ef req-31b9fbc1-1b67-4e10-adab-6c8489ab7680 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Refreshing network info cache for port bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:19:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:45 user nova-compute[74658]: DEBUG nova.network.neutron [req-92ada3e2-2a44-4f81-9921-9d9b903473ef req-31b9fbc1-1b67-4e10-adab-6c8489ab7680 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updated VIF entry in instance network info cache for port bdddb146-3305-47a7-a523-d6430b3d2ced. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:19:45 user nova-compute[74658]: DEBUG nova.network.neutron [req-92ada3e2-2a44-4f81-9921-9d9b903473ef req-31b9fbc1-1b67-4e10-adab-6c8489ab7680 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [{"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-92ada3e2-2a44-4f81-9921-9d9b903473ef req-31b9fbc1-1b67-4e10-adab-6c8489ab7680 service nova] Releasing lock "refresh_cache-48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG nova.compute.manager [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqQpSrtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11bd9639-1c9e-4080-bd89-bf34724684d5', 'attached_at': '', 'detached_at': '', 'volume_id': '15439dd8-bb51-4dc9-977f-08bfe205a586', 'serial': '15439dd8-bb51-4dc9-977f-08bfe205a586'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBpxUvXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '11bd9639-1c9e-4080-bd89-bf34724684d5', 'attached_at': '', 'detached_at': '', 'volume_id': '5fdbb33e-2491-44e7-a44a-deb930f43480', 'serial'} {{(pid=74658) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqQpSrtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:46 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:46 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:46 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aae310b-9a01-4e0f-85a9-f33e6a131902]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:19:46 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1878fe-2d26-4575-9e4c-c41c1c08b789]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586] added
Nov 16 15:19:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1135b391-3286-41eb-a14b-f9d95223ec71]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0090228-e55d-40ca-875e-6670b9aa76f0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YqQpSrtI {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YqQpSrtI" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd02a5f-e253-4b68-8603-5ced051ca31a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YqQpSrtI'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa6254e-6c0b-4baf-a9ec-0a70f7bff06b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e878689-2acd-4dc9-b1bf-ac39e10902d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ccc2dc-4580-42bf-8f48-3661c8ea0e39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586, portal: 172.16.0.220,3260]
Nov 16 15:19:47 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f36754-c945-48e0-a683-097ac10df23b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d656a4-117d-46ce-b366-e0b6934ae2d9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f0578e-0f17-4a46-b607-bda21f5820da]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqQpSrtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:47 user nova-compute[74658]: INFO nova.compute.manager [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Terminating instance
Nov 16 15:19:47 user nova-compute[74658]: DEBUG nova.compute.manager [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:19:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Creating image(s)
Nov 16 15:19:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Ensure instance console log exists: /opt/stack/data/nova/instances/d497d108-2eb4-448d-9d1f-e8864e0b48a4/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Start _get_guest_xml network_info=[{"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9ee56c2a-adcb-465d-bf30-7fd1e4bcda0e', 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRGUKVeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd497d108-2eb4-448d-9d1f-e8864e0b48a4', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0b36d65-b871-4dbe-88b0-eea4eae50d29', 'serial': 'c0b36d65-b871-4dbe-88b0-eea4eae50d29'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:19:47 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 15:19:47 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 15:19:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:19:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lazy-loading 'vcpu_model' on Instance uuid d497d108-2eb4-448d-9d1f-e8864e0b48a4 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRGUKVeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:48 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26136393534333639', 'path': '/dev/sdi'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136393534333639', 'path': '/dev/sdi'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.132s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:48 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:48 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.objects.instance [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lazy-loading 'flavor' on Instance uuid 11bd9639-1c9e-4080-bd89-bf34724684d5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[75961b84-f54e-4a0a-896f-10b0bf3c5311]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:19:48 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fce518-16da-41fe-ae0e-1753b9dd4409]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29] added
Nov 16 15:19:48 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-1c47994f-8dfa-42ef-8fa2-d0c1f544f2e9 req-1588b5f0-ac52-443e-8f3a-934c5fa2081a service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1c47994f-8dfa-42ef-8fa2-d0c1f544f2e9 req-1588b5f0-ac52-443e-8f3a-934c5fa2081a service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1c47994f-8dfa-42ef-8fa2-d0c1f544f2e9 req-1588b5f0-ac52-443e-8f3a-934c5fa2081a service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1c47994f-8dfa-42ef-8fa2-d0c1f544f2e9 req-1588b5f0-ac52-443e-8f3a-934c5fa2081a service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-1c47994f-8dfa-42ef-8fa2-d0c1f544f2e9 req-1588b5f0-ac52-443e-8f3a-934c5fa2081a service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-unplugged-bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-1c47994f-8dfa-42ef-8fa2-d0c1f544f2e9 req-1588b5f0-ac52-443e-8f3a-934c5fa2081a service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-bdddb146-3305-47a7-a523-d6430b3d2ced for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[050c20dd-e882-41d2-a4ac-bb68c6ddbc8e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[da297506-7a66-4333-a0c1-2078f674eea8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRGUKVeB {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRGUKVeB" returned: 0 in 0.050s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1930a4f-cffa-4e2c-a9aa-6c0a3c774572]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NRGUKVeB'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.053s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5c1b72-415b-42f6-acee-d4124c5554b8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d455c4d3-8a51-4069-b35d-afe8cc117800]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc224bd9-b652-4c39-9a36-ae183e4b38e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260]
Nov 16 15:19:48 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:48 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[75396dff-5d63-474c-adaf-a48d17e498d2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-2018181b-df35-4219-8ced-1f3b03001c3c req-114b562d-2a20-4675-9abd-167cc471d680 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-a61ce95b-32ea-48c9-b694-df72d417424d {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2018181b-df35-4219-8ced-1f3b03001c3c req-114b562d-2a20-4675-9abd-167cc471d680 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2018181b-df35-4219-8ced-1f3b03001c3c req-114b562d-2a20-4675-9abd-167cc471d680 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2018181b-df35-4219-8ced-1f3b03001c3c req-114b562d-2a20-4675-9abd-167cc471d680 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-2018181b-df35-4219-8ced-1f3b03001c3c req-114b562d-2a20-4675-9abd-167cc471d680 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-unplugged-a61ce95b-32ea-48c9-b694-df72d417424d {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-2018181b-df35-4219-8ced-1f3b03001c3c req-114b562d-2a20-4675-9abd-167cc471d680 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-a61ce95b-32ea-48c9-b694-df72d417424d for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7ed9d7-3dc2-4464-9f6e-bc1b00762b22]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:48 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.525s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.029s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fa43a0-f6b2-4d1c-adef-e0963af67aca]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRGUKVeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 133169152 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-876e7eab-ce8d-46d3-9c4b-3b737b269be4 req-71d6a619-ae0f-4961-8c82-ba432c827f63 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-876e7eab-ce8d-46d3-9c4b-3b737b269be4 req-71d6a619-ae0f-4961-8c82-ba432c827f63 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-876e7eab-ce8d-46d3-9c4b-3b737b269be4 req-71d6a619-ae0f-4961-8c82-ba432c827f63 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-876e7eab-ce8d-46d3-9c4b-3b737b269be4 req-71d6a619-ae0f-4961-8c82-ba432c827f63 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-876e7eab-ce8d-46d3-9c4b-3b737b269be4 req-71d6a619-ae0f-4961-8c82-ba432c827f63 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-unplugged-5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-876e7eab-ce8d-46d3-9c4b-3b737b269be4 req-71d6a619-ae0f-4961-8c82-ba432c827f63 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-5057a6c2-fa75-49df-a09f-b782ad2646fa for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 305135616 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.582s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] <== connect_volume: return (1715ms) {'type': 'block', 'scsi_wwn': '23366333934363537', 'path': '/dev/sdj'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366333934363537', 'path': '/dev/sdj'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1774448289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-950433439',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkap0gRNcurWDfCcy7qt804/okYphbvtBgQJOzKxESAFGAYHBwlIXmSq28wC/by2fh2JpmwGxBO4odLx6IdBKSumHSyV2ncRWbtbwWfg4j7iPSMFgyo5c1IQ1GaeCy8NQ==',key_name='tempest-keypair-790246539',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34629163159f48e5a7e45cc79cd11abb',ramdisk_id='',reservation_id='r-rlllv1i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-912489320',owner_user_name='tempest-ServerActionsV293TestJSON-912489320-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='112ea992e8a5439d80ab8032c5f4074d',uuid=d497d108-2eb4-448d-9d1f-e8864e0b48a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converting VIF {"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:19:49 user nova-compute[74658]:   <uuid>d497d108-2eb4-448d-9d1f-e8864e0b48a4</uuid>
Nov 16 15:19:49 user nova-compute[74658]:   <name>instance-00000007</name>
Nov 16 15:19:49 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:19:49 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:19:49 user nova-compute[74658]:   <metadata>
Nov 16 15:19:49 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:19:49 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:19:49 user nova-compute[74658]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1774448289</nova:name>
Nov 16 15:19:49 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:19:47</nova:creationTime>
Nov 16 15:19:49 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:19:49 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:19:49 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:19:49 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:19:49 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:19:49 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:19:49 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:19:49 user nova-compute[74658]:       <nova:owner>
Nov 16 15:19:49 user nova-compute[74658]:         <nova:user uuid="112ea992e8a5439d80ab8032c5f4074d">tempest-ServerActionsV293TestJSON-912489320-project-member</nova:user>
Nov 16 15:19:49 user nova-compute[74658]:         <nova:project uuid="34629163159f48e5a7e45cc79cd11abb">tempest-ServerActionsV293TestJSON-912489320</nova:project>
Nov 16 15:19:49 user nova-compute[74658]:       </nova:owner>
Nov 16 15:19:49 user nova-compute[74658]:       <nova:ports>
Nov 16 15:19:49 user nova-compute[74658]:         <nova:port uuid="64c01998-6dfe-48d7-8e96-baf6a9cce100">
Nov 16 15:19:49 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 15:19:49 user nova-compute[74658]:         </nova:port>
Nov 16 15:19:49 user nova-compute[74658]:       </nova:ports>
Nov 16 15:19:49 user nova-compute[74658]:     </nova:instance>
Nov 16 15:19:49 user nova-compute[74658]:   </metadata>
Nov 16 15:19:49 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:19:49 user nova-compute[74658]:     <system>
Nov 16 15:19:49 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:19:49 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:19:49 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:19:49 user nova-compute[74658]:       <entry name="serial">d497d108-2eb4-448d-9d1f-e8864e0b48a4</entry>
Nov 16 15:19:49 user nova-compute[74658]:       <entry name="uuid">d497d108-2eb4-448d-9d1f-e8864e0b48a4</entry>
Nov 16 15:19:49 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:19:49 user nova-compute[74658]:     </system>
Nov 16 15:19:49 user nova-compute[74658]:   </sysinfo>
Nov 16 15:19:49 user nova-compute[74658]:   <os>
Nov 16 15:19:49 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:19:49 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:19:49 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:19:49 user nova-compute[74658]:   </os>
Nov 16 15:19:49 user nova-compute[74658]:   <features>
Nov 16 15:19:49 user nova-compute[74658]:     <acpi/>
Nov 16 15:19:49 user nova-compute[74658]:     <apic/>
Nov 16 15:19:49 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:19:49 user nova-compute[74658]:   </features>
Nov 16 15:19:49 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:19:49 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:19:49 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:19:49 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:19:49 user nova-compute[74658]:   </clock>
Nov 16 15:19:49 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:19:49 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:19:49 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:19:49 user nova-compute[74658]:   </cpu>
Nov 16 15:19:49 user nova-compute[74658]:   <devices>
Nov 16 15:19:49 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:19:49 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:49 user nova-compute[74658]:       <source dev="/dev/sdj"/>
Nov 16 15:19:49 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:19:49 user nova-compute[74658]:       <serial>c0b36d65-b871-4dbe-88b0-eea4eae50d29</serial>
Nov 16 15:19:49 user nova-compute[74658]:     </disk>
Nov 16 15:19:49 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:19:49 user nova-compute[74658]:       <mac address="fa:16:3e:e3:63:a2"/>
Nov 16 15:19:49 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:19:49 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:19:49 user nova-compute[74658]:       <target dev="tap64c01998-6d"/>
Nov 16 15:19:49 user nova-compute[74658]:     </interface>
Nov 16 15:19:49 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:19:49 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/d497d108-2eb4-448d-9d1f-e8864e0b48a4/console.log" append="off"/>
Nov 16 15:19:49 user nova-compute[74658]:     </serial>
Nov 16 15:19:49 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:19:49 user nova-compute[74658]:     <video>
Nov 16 15:19:49 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:19:49 user nova-compute[74658]:     </video>
Nov 16 15:19:49 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:19:49 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:19:49 user nova-compute[74658]:     </rng>
Nov 16 15:19:49 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:19:49 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:19:49 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:19:49 user nova-compute[74658]:     </memballoon>
Nov 16 15:19:49 user nova-compute[74658]:   </devices>
Nov 16 15:19:49 user nova-compute[74658]: </domain>
Nov 16 15:19:49 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1774448289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-950433439',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkap0gRNcurWDfCcy7qt804/okYphbvtBgQJOzKxESAFGAYHBwlIXmSq28wC/by2fh2JpmwGxBO4odLx6IdBKSumHSyV2ncRWbtbwWfg4j7iPSMFgyo5c1IQ1GaeCy8NQ==',key_name='tempest-keypair-790246539',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34629163159f48e5a7e45cc79cd11abb',ramdisk_id='',reservation_id='r-rlllv1i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-912489320',owner_user_name='tempest-ServerActionsV293TestJSON-912489320-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='112ea992e8a5439d80ab8032c5f4074d',uuid=d497d108-2eb4-448d-9d1f-e8864e0b48a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converting VIF {"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG os_vif [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'effac83f-b733-584e-ab6d-24a8949c46a0', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64c01998-6d, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64c01998-6d, col_values=(('qos', UUID('638a8987-91a4-49ab-9617-c672115a292e')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64c01998-6d, col_values=(('external_ids', {'iface-id': '64c01998-6dfe-48d7-8e96-baf6a9cce100', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:63:a2', 'vm-uuid': 'd497d108-2eb4-448d-9d1f-e8864e0b48a4'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Instance destroyed successfully.
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.objects.instance [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lazy-loading 'resources' on Instance uuid 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=bdddb146-3305-47a7-a523-d6430b3d2ced,network=Network(e492e949-8450-47e1-a5b1-016645eafc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdddb146-33') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=bdddb146-3305-47a7-a523-d6430b3d2ced,network=Network(e492e949-8450-47e1-a5b1-016645eafc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdddb146-33') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: INFO os_vif [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d')
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdddb146-33, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 450887680 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2783357a-88df-41b3-9b6a-9eab548de1ae) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] No VIF found with MAC fa:16:3e:e3:63:a2, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: INFO os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=bdddb146-3305-47a7-a523-d6430b3d2ced,network=Network(e492e949-8450-47e1-a5b1-016645eafc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdddb146-33')
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=a187a46b-1664-43a5-986e-c6abadee65c6,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa187a46b-16') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=a187a46b-1664-43a5-986e-c6abadee65c6,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa187a46b-16') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa187a46b-16, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:50 user nova-compute[74658]: WARNING nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-bdddb146-3305-47a7-a523-d6430b3d2ced for instance with vm_state active and task_state deleting.
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-a187a46b-1664-43a5-986e-c6abadee65c6 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-unplugged-a187a46b-1664-43a5-986e-c6abadee65c6 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-a187a46b-1664-43a5-986e-c6abadee65c6 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-a187a46b-1664-43a5-986e-c6abadee65c6 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-a187a46b-1664-43a5-986e-c6abadee65c6 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:50 user nova-compute[74658]: WARNING nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-a187a46b-1664-43a5-986e-c6abadee65c6 for instance with vm_state active and task_state deleting.
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-unplugged-2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-2547184e-c859-4452-9e1d-da23edc28844 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:50 user nova-compute[74658]: WARNING nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-2547184e-c859-4452-9e1d-da23edc28844 for instance with vm_state active and task_state deleting.
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-unplugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:50 user nova-compute[74658]: WARNING nova.compute.manager [req-9e9fdf0e-2ec6-44d2-bdc4-4ccebeeb3838 req-2511123c-4b24-4715-873a-996428d93fdd service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-34eb8f7c-8d0a-41f7-b221-68bf36c82cec for instance with vm_state active and task_state deleting.
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f70720f6-190b-4413-86bd-795f1332d88b) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: INFO os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=a187a46b-1664-43a5-986e-c6abadee65c6,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa187a46b-16')
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7b:ca,bridge_name='br-int',has_traffic_filtering=True,id=a61ce95b-32ea-48c9-b694-df72d417424d,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa61ce95b-32') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7b:ca,bridge_name='br-int',has_traffic_filtering=True,id=a61ce95b-32ea-48c9-b694-df72d417424d,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa61ce95b-32') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa61ce95b-32, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bd96574-8eab-4b69-8e35-59098884f87a) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 is timed out.
Nov 16 15:19:50 user nova-compute[74658]: INFO os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7b:ca,bridge_name='br-int',has_traffic_filtering=True,id=a61ce95b-32ea-48c9-b694-df72d417424d,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa61ce95b-32')
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "2547184e-c859-4452-9e1d-da23edc28844", "address": "fa:16:3e:24:2d:26", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2547184e-c8", "ovs_interfaceid": "2547184e-c859-4452-9e1d-da23edc28844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=2547184e-c859-4452-9e1d-da23edc28844,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2547184e-c8') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=2547184e-c859-4452-9e1d-da23edc28844,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2547184e-c8') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:19:50 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Successfully detached device sdc from instance ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 from the live domain config.
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2547184e-c8, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxKpHlbt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:50 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9aa5f0c-84d1-4a40-89df-64ed973581dc) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba1e75c-92bb-4b32-adc2-4b1b14c46e34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:19:50 user nova-compute[74658]: No targets found.
Nov 16 15:19:50 user nova-compute[74658]: iSNS:
Nov 16 15:19:50 user nova-compute[74658]: No targets found.
Nov 16 15:19:50 user nova-compute[74658]: STATIC:
Nov 16 15:19:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba
Nov 16 15:19:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0
Nov 16 15:19:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c
Nov 16 15:19:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:19:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586
Nov 16 15:19:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea
Nov 16 15:19:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4
Nov 16 15:19:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:19:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123
Nov 16 15:19:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:50 user nova-compute[74658]: FIRMWARE:
Nov 16 15:19:50 user nova-compute[74658]: No targets found.
Nov 16 15:19:50 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:19:50 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:19:50 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 569376768 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59d2d17-8d42-46ba-bb32-e1afcf2f3b9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: INFO os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=2547184e-c859-4452-9e1d-da23edc28844,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2547184e-c8')
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:41,bridge_name='br-int',has_traffic_filtering=True,id=34eb8f7c-8d0a-41f7-b221-68bf36c82cec,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34eb8f7c-8d') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:41,bridge_name='br-int',has_traffic_filtering=True,id=34eb8f7c-8d0a-41f7-b221-68bf36c82cec,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34eb8f7c-8d') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34eb8f7c-8d, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50d9a30-0ccd-484f-9a40-2dded61a4caa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:50 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f071071b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f59e121e-d339-463c-b02d-2467820d61fb) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-ebfc4ddf-5c9e-49bf-b0eb-f6870e9d4ce2 req-4837871e-a0f3-46b5-a0d1-42d845ebb4af service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-a61ce95b-32ea-48c9-b694-df72d417424d {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ebfc4ddf-5c9e-49bf-b0eb-f6870e9d4ce2 req-4837871e-a0f3-46b5-a0d1-42d845ebb4af service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ebfc4ddf-5c9e-49bf-b0eb-f6870e9d4ce2 req-4837871e-a0f3-46b5-a0d1-42d845ebb4af service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ebfc4ddf-5c9e-49bf-b0eb-f6870e9d4ce2 req-4837871e-a0f3-46b5-a0d1-42d845ebb4af service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-ebfc4ddf-5c9e-49bf-b0eb-f6870e9d4ce2 req-4837871e-a0f3-46b5-a0d1-42d845ebb4af service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-a61ce95b-32ea-48c9-b694-df72d417424d {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:50 user nova-compute[74658]: WARNING nova.compute.manager [req-ebfc4ddf-5c9e-49bf-b0eb-f6870e9d4ce2 req-4837871e-a0f3-46b5-a0d1-42d845ebb4af service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-a61ce95b-32ea-48c9-b694-df72d417424d for instance with vm_state active and task_state deleting.
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74d62a2-360d-4421-93ca-c1c727e14213]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: INFO os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:41,bridge_name='br-int',has_traffic_filtering=True,id=34eb8f7c-8d0a-41f7-b221-68bf36c82cec,network=Network(19a82dc3-bae1-4b20-86a3-975190f465cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34eb8f7c-8d')
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:32:00,bridge_name='br-int',has_traffic_filtering=True,id=7174d7e9-282f-485b-b06a-8edd4b9ebb52,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7174d7e9-28') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:32:00,bridge_name='br-int',has_traffic_filtering=True,id=7174d7e9-282f-485b-b06a-8edd4b9ebb52,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7174d7e9-28') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7174d7e9-28, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.035s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[01127858-49da-4016-a451-afa383618923]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2eb723cd-0c50-4bf3-8fc2-29d2dea3471d) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5acf84-5098-427f-9f25-14f3381aef74]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: INFO os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:32:00,bridge_name='br-int',has_traffic_filtering=True,id=7174d7e9-282f-485b-b06a-8edd4b9ebb52,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7174d7e9-28')
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-279553808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-279553808',id=11,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JxAVw6wz/DrKTUjG7SoDvodec0JXbwC3P1yPVjf84cuge5kdhSBkkVibMlK5qw+90wxLShnmXMnskb6pvACmLiypNYZJZT9enH0YzbmtQa9t4sMVDpcnpKuOYFr7L5Q==',key_name='tempest-keypair-237305610',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='099c984ee9724b058a8611c5482cdc10',ramdisk_id='',reservation_id='r-uymkqh8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-355803186',owner_user_name='tempest-TaggedBootDevicesTest_v242-355803186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cecb346ee3a94c90aedb89436ad41db8',uuid=48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converting VIF {"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:6f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5057a6c2-fa75-49df-a09f-b782ad2646fa,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057a6c2-fa') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:6f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5057a6c2-fa75-49df-a09f-b782ad2646fa,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057a6c2-fa') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5057a6c2-fa, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6ab594f-6bed-4af8-aec9-ecffe04cebc6) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e18d96-b2d5-485f-b6c6-b79b2e01509a]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:50 user nova-compute[74658]: INFO os_vif [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:6f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5057a6c2-fa75-49df-a09f-b782ad2646fa,network=Network(57916ffc-b095-40de-acb6-bf77c22208b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057a6c2-fa')
Nov 16 15:19:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoKHIgJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:50 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c8be02-661f-44c7-bd3c-886e2e231f78]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[924d5ad7-10d0-4c9c-9263-a64749f1f028]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123, portal: 172.16.0.220,3260]
Nov 16 15:19:51 user nova-compute[74658]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a8b0f2-1a44-4568-8ca7-2e03f1e2e123 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e53bb9-6b0a-4d0b-a433-0cb1fa68ea6a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.471s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] <== disconnect_volume: return (472ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.178s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.039s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[059c4399-2b7a-4bf3-acbb-19736e657154]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:19:51 user nova-compute[74658]: No targets found.
Nov 16 15:19:51 user nova-compute[74658]: iSNS:
Nov 16 15:19:51 user nova-compute[74658]: No targets found.
Nov 16 15:19:51 user nova-compute[74658]: STATIC:
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: FIRMWARE:
Nov 16 15:19:51 user nova-compute[74658]: No targets found.
Nov 16 15:19:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:19:51 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:19:51 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40c60c5-42b8-4ea6-9fc5-50dafbe04552]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 735051776 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[751d7040-eeea-4300-9f45-53e1c74aff5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f071075a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbc5356-155f-4d17-8560-7f9add8b0b46]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5b91d5-7128-4e45-8424-fad285dfb862]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b641dc-8d30-4a9c-9873-af7bb7a07d4c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[77385abf-3fbe-418a-819d-e6e5e2477823]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bdd565-1cf0-4584-adb0-67a70d8c45ef]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-e8e31bd0-5c75-42d8-a04a-701773f0320e req-837d822c-32fb-4dcd-a7fb-1b180a3b56ed service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e8e31bd0-5c75-42d8-a04a-701773f0320e req-837d822c-32fb-4dcd-a7fb-1b180a3b56ed service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e8e31bd0-5c75-42d8-a04a-701773f0320e req-837d822c-32fb-4dcd-a7fb-1b180a3b56ed service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e8e31bd0-5c75-42d8-a04a-701773f0320e req-837d822c-32fb-4dcd-a7fb-1b180a3b56ed service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-e8e31bd0-5c75-42d8-a04a-701773f0320e req-837d822c-32fb-4dcd-a7fb-1b180a3b56ed service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:51 user nova-compute[74658]: WARNING nova.compute.manager [req-e8e31bd0-5c75-42d8-a04a-701773f0320e req-837d822c-32fb-4dcd-a7fb-1b180a3b56ed service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-5057a6c2-fa75-49df-a09f-b782ad2646fa for instance with vm_state active and task_state deleting.
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[701c37ef-fe9c-4d7f-a933-7a52b3ff89c4]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4, portal: 172.16.0.220,3260]
Nov 16 15:19:51 user nova-compute[74658]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6670f484-f45a-40d3-985f-2f4da8490ef4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59bf2dc-8541-4448-903f-f59ca01e84db]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] <== disconnect_volume: return (597ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxhUJgDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:51 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecf1b98-1d4e-49ec-8106-6bab5d7038a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:19:51 user nova-compute[74658]: No targets found.
Nov 16 15:19:51 user nova-compute[74658]: iSNS:
Nov 16 15:19:51 user nova-compute[74658]: No targets found.
Nov 16 15:19:51 user nova-compute[74658]: STATIC:
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: FIRMWARE:
Nov 16 15:19:51 user nova-compute[74658]: No targets found.
Nov 16 15:19:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:19:51 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:19:51 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf9f6ce-a500-4207-875f-5719f240a205]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdb55e5-8873-4036-8a8a-5ce9623398f7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:51 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f071075a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0'): ({'sdd'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Removing single pathed devices sdd {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadbfe6f-d3a5-4d6f-a185-a533c69404b2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a9eaa6-47c1-460e-95c3-dcc6c6a73ccc]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Flushing IO for device /dev/sdd {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[891f2e9e-1ce9-4343-bfeb-8ffbf70d8a89]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 832569344 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[04712690-46af-40f5-be28-6e9482bbd9eb]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[181d8c48-f78a-47bb-b413-f4dfc816c8b2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee1e78a-16eb-4a00-8bb0-18f37a28a67f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0, portal: 172.16.0.220,3260]
Nov 16 15:19:51 user nova-compute[74658]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44367556-dcc5-4738-ac00-f8a6c678e3b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4eacd9-767b-4031-b07d-a82b4ffd5157]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] <== disconnect_volume: return (407ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLcIAYOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:51 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[842992d1-484a-44c3-a6de-ae0a63cf8480]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:19:51 user nova-compute[74658]: No targets found.
Nov 16 15:19:51 user nova-compute[74658]: iSNS:
Nov 16 15:19:51 user nova-compute[74658]: No targets found.
Nov 16 15:19:51 user nova-compute[74658]: STATIC:
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:19:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:51 user nova-compute[74658]: FIRMWARE:
Nov 16 15:19:51 user nova-compute[74658]: No targets found.
Nov 16 15:19:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:19:51 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:19:51 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:19:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bac9a04-71f9-49fd-bdff-8066c3cb1c3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af237ed-959d-4c3a-9f5c-00825b38d012]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07100fd120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba'): ({'sde'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Removing single pathed devices sde {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46e56cf-acbd-4459-9aa4-8b5d4a2b0a7f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b173aac-6c85-4770-b05b-7502fa9c6803]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Flushing IO for device /dev/sde {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caacab0-8986-4470-8623-afd12b1ff8a8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a6c2a3-d6a3-4e7a-aab8-bcf0d454a453]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] SCSI volumes sde have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 989855744 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e31f6f7-6ff7-4a7a-b66d-d3d45a450518]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8b0a9b-beaa-48b8-9e4c-78f3c3f6b8da]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba, portal: 172.16.0.220,3260]
Nov 16 15:19:52 user nova-compute[74658]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:52 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff992e-30ec-454d-8afe-0ba59c1e01ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d8bec9-4fa7-4e75-b930-3e15485f0807]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] <== disconnect_volume: return (419ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:19:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Deleting instance files /opt/stack/data/nova/instances/48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2_del
Nov 16 15:19:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Deletion of /opt/stack/data/nova/instances/48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2_del complete
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-unplugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-unplugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-plugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] Acquiring lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] No waiting events found dispatching network-vif-plugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:52 user nova-compute[74658]: WARNING nova.compute.manager [req-3520081f-e1cb-46d3-bf52-ef3b73118f31 req-b9e946fe-9713-41f2-a9cd-85b22c2bfbf8 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received unexpected event network-vif-plugged-7174d7e9-282f-485b-b06a-8edd4b9ebb52 for instance with vm_state active and task_state deleting.
Nov 16 15:19:52 user nova-compute[74658]: INFO nova.compute.manager [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Took 4.48 seconds to destroy the instance on the hypervisor.
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.objects.instance [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lazy-loading 'flavor' on Instance uuid ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-24a8073b-4b53-42b6-b3a2-7fe6862afd6d tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.592s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] No waiting events found dispatching network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:52 user nova-compute[74658]: WARNING nova.compute.manager [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received unexpected event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] No waiting events found dispatching network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:52 user nova-compute[74658]: WARNING nova.compute.manager [req-d510acd3-111c-4234-9d50-0d389befef91 req-0e41a281-f178-40a7-8fdb-188d384cd5cf service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received unexpected event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 15:19:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBpxUvXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:52 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c4c455-a058-4c3e-94b0-cbc28130eeef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:19:52 user nova-compute[74658]: No targets found.
Nov 16 15:19:52 user nova-compute[74658]: iSNS:
Nov 16 15:19:52 user nova-compute[74658]: No targets found.
Nov 16 15:19:52 user nova-compute[74658]: STATIC:
Nov 16 15:19:52 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c
Nov 16 15:19:52 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:52 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:52 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:19:52 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:52 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:52 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586
Nov 16 15:19:52 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:52 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:52 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea
Nov 16 15:19:52 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:52 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:52 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:19:52 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:19:52 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:19:52 user nova-compute[74658]: FIRMWARE:
Nov 16 15:19:52 user nova-compute[74658]: No targets found.
Nov 16 15:19:52 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:19:52 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:19:52 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d747f3-354d-4dba-bd69-58f7b90598aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[303acec3-11fa-46a6-94e1-ac386664afea]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:19:52 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07107585e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480'): ({'sdg'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Removing single pathed devices sdg {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c21e861-2319-4e09-ba5d-9255d75acff5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfca30c-fe7c-4d21-ab42-b97569fb5f9d]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Flushing IO for device /dev/sdg {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:19:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf1c605-9c37-4a14-bb4c-019d412827cb]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9818563-e9e4-4b66-b6d1-ed78b66b7f2b]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] SCSI volumes sdg have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21a4d67-3c60-4eeb-8e88-dc233f2a083e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5253d97-663a-4aa0-8d92-76504c9dce17]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260]
Nov 16 15:19:53 user nova-compute[74658]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260] successful.
Nov 16 15:19:53 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa12c80-a980-4ab0-8db4-8cb4336d12ed]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] <== disconnect_volume: return (352ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqQpSrtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '11bd9639-1c9e-4080-bd89-bf34724684d5', 'attached_at': '', 'detached_at': '', 'volume_id': '15439dd8-bb51-4dc9-977f-08bfe205a586', 'serial'} {{(pid=74658) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] swap_volume: removing Cinder connection for volume 5fdbb33e-2491-44e7-a44a-deb930f43480 {{(pid=74658) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:53 user nova-compute[74658]: INFO nova.compute.manager [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Terminating instance
Nov 16 15:19:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-78620bab-07bf-4c15-93d3-0b463f4afb3a req-c4f72c45-de7d-4d5e-8e59-bd20b9e32102 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Received event network-vif-unplugged-cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78620bab-07bf-4c15-93d3-0b463f4afb3a req-c4f72c45-de7d-4d5e-8e59-bd20b9e32102 service nova] Acquiring lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78620bab-07bf-4c15-93d3-0b463f4afb3a req-c4f72c45-de7d-4d5e-8e59-bd20b9e32102 service nova] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78620bab-07bf-4c15-93d3-0b463f4afb3a req-c4f72c45-de7d-4d5e-8e59-bd20b9e32102 service nova] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-78620bab-07bf-4c15-93d3-0b463f4afb3a req-c4f72c45-de7d-4d5e-8e59-bd20b9e32102 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] No waiting events found dispatching network-vif-unplugged-cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-78620bab-07bf-4c15-93d3-0b463f4afb3a req-c4f72c45-de7d-4d5e-8e59-bd20b9e32102 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Received event network-vif-unplugged-cd4edd24-4702-4a79-af81-025dc029758b for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:19:54 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Instance spawned successfully.
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.compute.manager [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] swap_volume: Updating volume 5fdbb33e-2491-44e7-a44a-deb930f43480 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "YqQpSrtI", "auth_password": "FcAaH1xgdeJRlX", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "15439dd8-bb51-4dc9-977f-08bfe205a586"}, "status": "reserved", "instance": "11bd9639-1c9e-4080-bd89-bf34724684d5", "attached_at": "", "detached_at": "", "volume_id": "15439dd8-bb51-4dc9-977f-08bfe205a586", "serial": "15439dd8-bb51-4dc9-977f-08bfe205a586"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '15439dd8-bb51-4dc9-977f-08bfe205a586', 'no_device': None, 'attachment_id': '82138873-dfbd-4592-9a20-d66a05092123'} {{(pid=74658) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-569b98ec-013c-4966-bfec-7bc5fb87b129 tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.266s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:19:54 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Instance destroyed successfully.
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.objects.instance [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lazy-loading 'resources' on Instance uuid ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-645911138',display_name='tempest-AttachSCSIVolumeTestJSON-server-645911138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-645911138',id=6,image_ref='18115ea9-3d07-49cf-9980-85c2de757a95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAtMFF0sUIBU74bkLIuQqHbB9jEcxzQEh3oSnF10lcr6f+ZpaY4b3FZcjHq2k/obqTXkjUjQ3vBbiqqNVRMO3JvcvrA70/wQyBMyCvoEkI4Ryd8QgFibGZK7F2skn3rHA==',key_name='tempest-keypair-1462490108',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c8383a2cd0549d999afd14c6e8f373b',ramdisk_id='',reservation_id='r-l7t8ud7f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18115ea9-3d07-49cf-9980-85c2de757a95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1051769831',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1051769831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:17:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d2f1a679134ca795d13abc1d82ed0f',uuid=ce63bd89-0244-4c17-b769-ddbc6ed4b8f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd4edd24-4702-4a79-af81-025dc029758b", "address": "fa:16:3e:f1:2a:ca", "network": {"id": "4782d17a-7d24-40e4-8098-22b2ea2b6a31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1120804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8383a2cd0549d999afd14c6e8f373b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4edd24-47", "ovs_interfaceid": "cd4edd24-4702-4a79-af81-025dc029758b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Converting VIF {"id": "cd4edd24-4702-4a79-af81-025dc029758b", "address": "fa:16:3e:f1:2a:ca", "network": {"id": "4782d17a-7d24-40e4-8098-22b2ea2b6a31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1120804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8383a2cd0549d999afd14c6e8f373b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4edd24-47", "ovs_interfaceid": "cd4edd24-4702-4a79-af81-025dc029758b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:2a:ca,bridge_name='br-int',has_traffic_filtering=True,id=cd4edd24-4702-4a79-af81-025dc029758b,network=Network(4782d17a-7d24-40e4-8098-22b2ea2b6a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4edd24-47') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG os_vif [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:2a:ca,bridge_name='br-int',has_traffic_filtering=True,id=cd4edd24-4702-4a79-af81-025dc029758b,network=Network(4782d17a-7d24-40e4-8098-22b2ea2b6a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4edd24-47') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd4edd24-47, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a700dae-8617-449c-a92b-8d146fa22e31) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:19:54 user nova-compute[74658]: INFO os_vif [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:2a:ca,bridge_name='br-int',has_traffic_filtering=True,id=cd4edd24-4702-4a79-af81-025dc029758b,network=Network(4782d17a-7d24-40e4-8098-22b2ea2b6a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4edd24-47')
Nov 16 15:19:54 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Deleting instance files /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9_del
Nov 16 15:19:54 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Deletion of /opt/stack/data/nova/instances/ce63bd89-0244-4c17-b769-ddbc6ed4b8f9_del complete
Nov 16 15:19:54 user nova-compute[74658]: INFO nova.compute.manager [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74658) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5626036c-63fc-498d-840b-fd6fd7d61ab1 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-5cbfd1fc-9715-43e3-a41e-668cd452a91d req-47b13fee-54c4-4979-bfad-573a0ab74f34 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-deleted-2547184e-c859-4452-9e1d-da23edc28844 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:54 user nova-compute[74658]: INFO nova.compute.manager [req-5cbfd1fc-9715-43e3-a41e-668cd452a91d req-47b13fee-54c4-4979-bfad-573a0ab74f34 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Neutron deleted interface 2547184e-c859-4452-9e1d-da23edc28844; detaching it from the instance and deleting it from the info cache
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-5cbfd1fc-9715-43e3-a41e-668cd452a91d req-47b13fee-54c4-4979-bfad-573a0ab74f34 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [{"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "address": "fa:16:3e:ff:6f:7e", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057a6c2-fa", "ovs_interfaceid": "5057a6c2-fa75-49df-a09f-b782ad2646fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-5cbfd1fc-9715-43e3-a41e-668cd452a91d req-47b13fee-54c4-4979-bfad-573a0ab74f34 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Detach interface failed, port_id=2547184e-c859-4452-9e1d-da23edc28844, reason: Instance 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-5cbfd1fc-9715-43e3-a41e-668cd452a91d req-47b13fee-54c4-4979-bfad-573a0ab74f34 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-deleted-5057a6c2-fa75-49df-a09f-b782ad2646fa {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:54 user nova-compute[74658]: INFO nova.compute.manager [req-5cbfd1fc-9715-43e3-a41e-668cd452a91d req-47b13fee-54c4-4979-bfad-573a0ab74f34 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Neutron deleted interface 5057a6c2-fa75-49df-a09f-b782ad2646fa; detaching it from the instance and deleting it from the info cache
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-5cbfd1fc-9715-43e3-a41e-668cd452a91d req-47b13fee-54c4-4979-bfad-573a0ab74f34 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [{"id": "bdddb146-3305-47a7-a523-d6430b3d2ced", "address": "fa:16:3e:21:55:bb", "network": {"id": "e492e949-8450-47e1-a5b1-016645eafc26", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1171180451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdddb146-33", "ovs_interfaceid": "bdddb146-3305-47a7-a523-d6430b3d2ced", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a187a46b-1664-43a5-986e-c6abadee65c6", "address": "fa:16:3e:dd:f2:80", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa187a46b-16", "ovs_interfaceid": "a187a46b-1664-43a5-986e-c6abadee65c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a61ce95b-32ea-48c9-b694-df72d417424d", "address": "fa:16:3e:1e:7b:ca", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61ce95b-32", "ovs_interfaceid": "a61ce95b-32ea-48c9-b694-df72d417424d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "address": "fa:16:3e:68:d1:41", "network": {"id": "19a82dc3-bae1-4b20-86a3-975190f465cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1375640801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34eb8f7c-8d", "ovs_interfaceid": "34eb8f7c-8d0a-41f7-b221-68bf36c82cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "address": "fa:16:3e:45:32:00", "network": {"id": "57916ffc-b095-40de-acb6-bf77c22208b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1503537357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "099c984ee9724b058a8611c5482cdc10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7174d7e9-28", "ovs_interfaceid": "7174d7e9-282f-485b-b06a-8edd4b9ebb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-5cbfd1fc-9715-43e3-a41e-668cd452a91d req-47b13fee-54c4-4979-bfad-573a0ab74f34 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Detach interface failed, port_id=5057a6c2-fa75-49df-a09f-b782ad2646fa, reason: Instance 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:19:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-b0d8d944-02c7-411a-bfd1-8c0fb5c0f1bc req-5b6c0e87-0556-40c1-bbe5-6e62ff1d5496 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Received event network-vif-plugged-cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b0d8d944-02c7-411a-bfd1-8c0fb5c0f1bc req-5b6c0e87-0556-40c1-bbe5-6e62ff1d5496 service nova] Acquiring lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b0d8d944-02c7-411a-bfd1-8c0fb5c0f1bc req-5b6c0e87-0556-40c1-bbe5-6e62ff1d5496 service nova] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b0d8d944-02c7-411a-bfd1-8c0fb5c0f1bc req-5b6c0e87-0556-40c1-bbe5-6e62ff1d5496 service nova] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-b0d8d944-02c7-411a-bfd1-8c0fb5c0f1bc req-5b6c0e87-0556-40c1-bbe5-6e62ff1d5496 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] No waiting events found dispatching network-vif-plugged-cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:19:55 user nova-compute[74658]: WARNING nova.compute.manager [req-b0d8d944-02c7-411a-bfd1-8c0fb5c0f1bc req-5b6c0e87-0556-40c1-bbe5-6e62ff1d5496 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Received unexpected event network-vif-plugged-cd4edd24-4702-4a79-af81-025dc029758b for instance with vm_state active and task_state deleting.
Nov 16 15:19:55 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-13a6f841-e56c-45f0-9864-f29800857635 req-902405b8-09c3-4cf7-81b6-a3d341c42bf4 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Received event network-vif-deleted-cd4edd24-4702-4a79-af81-025dc029758b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:55 user nova-compute[74658]: INFO nova.compute.manager [req-13a6f841-e56c-45f0-9864-f29800857635 req-902405b8-09c3-4cf7-81b6-a3d341c42bf4 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Neutron deleted interface cd4edd24-4702-4a79-af81-025dc029758b; detaching it from the instance and deleting it from the info cache
Nov 16 15:19:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-13a6f841-e56c-45f0-9864-f29800857635 req-902405b8-09c3-4cf7-81b6-a3d341c42bf4 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:55 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Took 1.46 seconds to deallocate network for instance.
Nov 16 15:19:55 user nova-compute[74658]: DEBUG os_brick.utils [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-13a6f841-e56c-45f0-9864-f29800857635 req-902405b8-09c3-4cf7-81b6-a3d341c42bf4 service nova] [instance: ce63bd89-0244-4c17-b769-ddbc6ed4b8f9] Detach interface failed, port_id=cd4edd24-4702-4a79-af81-025dc029758b, reason: Instance ce63bd89-0244-4c17-b769-ddbc6ed4b8f9 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a397fbe-9024-457b-abf6-120f82381bdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d7d68c-55ce-4947-b8be-e2e1ea3df64d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad97fa76-f202-40ee-ae51-a61a022a66c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7ffaba-30fa-4381-b3a8-a4abf9d0f3fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:19:56 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[22793b62-11d9-4ba9-a37d-9f046dac06f3]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG os_brick.utils [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:19:56 user nova-compute[74658]: INFO nova.compute.manager [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Swapping volume 15439dd8-bb51-4dc9-977f-08bfe205a586 for 5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.608s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:56 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Deleted allocations for instance ce63bd89-0244-4c17-b769-ddbc6ed4b8f9
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:19:56 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Took 4.28 seconds to deallocate network for instance.
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-66477552-e3a4-4e22-a6dc-c464e9f82c3c tempest-AttachSCSIVolumeTestJSON-1051769831 tempest-AttachSCSIVolumeTestJSON-1051769831-project-member] Lock "ce63bd89-0244-4c17-b769-ddbc6ed4b8f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.259s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-1d54df94-d6dc-4f64-b981-2f0ca72fca74 req-d33fb6bd-7b81-44b0-8d3d-7a47827a85a7 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-deleted-bdddb146-3305-47a7-a523-d6430b3d2ced {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-1d54df94-d6dc-4f64-b981-2f0ca72fca74 req-d33fb6bd-7b81-44b0-8d3d-7a47827a85a7 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-deleted-7174d7e9-282f-485b-b06a-8edd4b9ebb52 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-1d54df94-d6dc-4f64-b981-2f0ca72fca74 req-d33fb6bd-7b81-44b0-8d3d-7a47827a85a7 service nova] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Received event network-vif-deleted-34eb8f7c-8d0a-41f7-b221-68bf36c82cec {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:19:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:19:57 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Error from libvirt while getting description of instance-00000006: [Error Code 42] Domain not found: no domain with matching uuid 'ce63bd89-0244-4c17-b769-ddbc6ed4b8f9' (instance-00000006): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ce63bd89-0244-4c17-b769-ddbc6ed4b8f9' (instance-00000006)
Nov 16 15:19:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:19:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:19:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:19:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7516MB free_disk=25.57327651977539GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 03cbebbf-5414-4309-bfc1-ec0a67e09a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e06fcb99-9271-48da-ac95-3998d45e6ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 51f00d67-ae3d-4d1b-a721-280bae2e9caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance d497d108-2eb4-448d-9d1f-e8864e0b48a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 11bd9639-1c9e-4080-bd89-bf34724684d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance a2f77c43-8afd-465a-bb09-537cc3c6461d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7a8d82d1-5263-472d-8491-1abc709404dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:19:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:59 user nova-compute[74658]: INFO nova.compute.manager [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Detaching volume 6015d269-89f9-4107-9609-59bf546595ea
Nov 16 15:19:59 user nova-compute[74658]: INFO nova.compute.manager [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] [instance: 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2] Took 2.37 seconds to detach 3 volumes for instance.
Nov 16 15:19:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:19:59 user nova-compute[74658]: INFO nova.virt.block_device [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Attempting to driver detach volume 6015d269-89f9-4107-9609-59bf546595ea from mountpoint /dev/vdb
Nov 16 15:19:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Attempting to detach device vdb from instance 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:19:59 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:59 user nova-compute[74658]:   <source dev="/dev/sdf"/>
Nov 16 15:19:59 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:19:59 user nova-compute[74658]:   <serial>6015d269-89f9-4107-9609-59bf546595ea</serial>
Nov 16 15:19:59 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:19:59 user nova-compute[74658]: </disk>
Nov 16 15:19:59 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:19:59 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Successfully detached device vdb from instance 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f from the persistent domain config.
Nov 16 15:19:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:19:59 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:19:59 user nova-compute[74658]:   <source dev="/dev/sdf"/>
Nov 16 15:19:59 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:19:59 user nova-compute[74658]:   <serial>6015d269-89f9-4107-9609-59bf546595ea</serial>
Nov 16 15:19:59 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:19:59 user nova-compute[74658]: </disk>
Nov 16 15:19:59 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:59 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Deleted allocations for instance 48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2
Nov 16 15:19:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-dce26d9e-39c2-4866-95c5-c075b6a8898a tempest-TaggedBootDevicesTest_v242-355803186 tempest-TaggedBootDevicesTest_v242-355803186-project-member] Lock "48da2be2-86c4-4ee0-a4b4-5a6dc5c194b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.750s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:19:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updating instance_info_cache with network_info: [{"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:20:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBpxUvXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11bd9639-1c9e-4080-bd89-bf34724684d5', 'attached_at': '', 'detached_at': '', 'volume_id': '5fdbb33e-2491-44e7-a44a-deb930f43480', 'serial': '5fdbb33e-2491-44e7-a44a-deb930f43480'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqQpSrtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '15439dd8-bb51-4dc9-977f-08bfe205a586'}, 'status': 'reserved', 'instance': '11bd9639-1c9e-4080-bd89-bf34724684d5', 'attached_at': '', 'detached_at': '', 'volume_id': '15439dd8-bb51-4dc9-977f-08bfe205a586', 'serial'} {{(pid=74658) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBpxUvXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:20:02 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:20:02 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:20:02 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7404674-6c31-46ed-95df-8309cbadd227]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:20:02 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[443f44ac-d20d-45fa-bd9d-8bcd11ac3930]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480] added
Nov 16 15:20:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e14f2c-127b-4a19-9bcd-9a5b8b87bca4]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b7dc5e-1d84-41c8-9e47-657ed9f4d970]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eBpxUvXH {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eBpxUvXH" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[087f9a19-21e7-4663-b01c-169d4ad51c0a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eBpxUvXH'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a754b3-c49d-4fbb-815e-8095e139b160]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7742a626-401c-4a4b-82bf-3b0a9167a6d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c68bb5-07d2-4612-bc05-3096e1c00a55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260]
Nov 16 15:20:02 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260] successful.
Nov 16 15:20:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cd452c-fbf6-4fb5-942e-89eaf920b5dd]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ad9b89-2e53-47e6-87ee-e75259fa5d51]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:02 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ecbcc4-80e2-480f-947f-e738c4332fd6]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBpxUvXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26634393432333834', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634393432333834', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lazy-loading 'flavor' on Instance uuid 11bd9639-1c9e-4080-bd89-bf34724684d5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:03 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2f77c43-8afd-465a-bb09-537cc3c6461d is timed out.
Nov 16 15:20:03 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Successfully detached device vdb from instance a2f77c43-8afd-465a-bb09-537cc3c6461d from the live domain config.
Nov 16 15:20:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBHJKqQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:20:03 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a2c5cb-d899-49f7-b1bd-1393a1b42054]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:20:03 user nova-compute[74658]: No targets found.
Nov 16 15:20:03 user nova-compute[74658]: iSNS:
Nov 16 15:20:03 user nova-compute[74658]: No targets found.
Nov 16 15:20:03 user nova-compute[74658]: STATIC:
Nov 16 15:20:03 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c
Nov 16 15:20:03 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:03 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:03 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:20:03 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:03 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:03 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586
Nov 16 15:20:03 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:03 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:03 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea
Nov 16 15:20:03 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:03 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:03 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:20:03 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:03 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:03 user nova-compute[74658]: FIRMWARE:
Nov 16 15:20:03 user nova-compute[74658]: No targets found.
Nov 16 15:20:03 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:20:03 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:20:03 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c12ff-ee06-4ade-808a-786f4b8f3923]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[541f672f-1db9-49ad-82a3-be7079365167]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:20:03 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:20:03 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:20:03 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:03 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:03 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c (non-flash)
Nov 16 15:20:03 user nova-compute[74658]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:20:03 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:20:03 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:03 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:03 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07304f1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c'): ({'sdh'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Removing single pathed devices sdh {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f6f2c1-2b59-4502-899c-e59351a23ace]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[89094a44-d85f-46e1-a604-e96e448af02b]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Flushing IO for device /dev/sdh {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3e39ae-da84-4bc5-ac26-5dc6160c8d28]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c550a7d7-5c80-4604-b9cd-c00dda791e0d]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] SCSI volumes sdh have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f2c274-bf45-46c6-8905-1bb313853207]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e9bab9-d81b-4186-bd55-42ad2aa34470]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c, portal: 172.16.0.220,3260]
Nov 16 15:20:03 user nova-compute[74658]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c, portal: 172.16.0.220,3260] successful.
Nov 16 15:20:03 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c2238-b543-4c0c-96ba-6a408244d70c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0414d4-25c8-4521-bd0b-01da1b44075c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] <== disconnect_volume: return (354ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:20:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:20:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 164626432 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 294649856 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:05 user nova-compute[74658]: DEBUG nova.objects.instance [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lazy-loading 'flavor' on Instance uuid a2f77c43-8afd-465a-bb09-537cc3c6461d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 412090368 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3cae82-5c18-4209-a21a-6225e07a63bc tempest-VolumesAssistedSnapshotsTest-677473914 tempest-VolumesAssistedSnapshotsTest-677473914-project-admin] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.373s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 574619648 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 743440384 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 813694976 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 947912704 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 1019215872 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 1033895936 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 1053818880 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqQpSrtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '15439dd8-bb51-4dc9-977f-08bfe205a586'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:20:09 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e87906-83a6-49a1-9684-56f71276db4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:20:09 user nova-compute[74658]: No targets found.
Nov 16 15:20:09 user nova-compute[74658]: iSNS:
Nov 16 15:20:09 user nova-compute[74658]: No targets found.
Nov 16 15:20:09 user nova-compute[74658]: STATIC:
Nov 16 15:20:09 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:20:09 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:09 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:09 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586
Nov 16 15:20:09 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:09 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:09 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea
Nov 16 15:20:09 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:09 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:09 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:20:09 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:09 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:09 user nova-compute[74658]: FIRMWARE:
Nov 16 15:20:09 user nova-compute[74658]: No targets found.
Nov 16 15:20:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:20:09 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:20:09 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bf07f4-54d5-4f52-ab0f-5cc57f505f9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90a6a55-c8f6-4b91-b6d4-85a3841e8a20]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:20:09 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:20:09 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:09 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:20:09 user nova-compute[74658]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 (non-flash)
Nov 16 15:20:09 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:09 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710100430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586'): ({'sdi'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Removing single pathed devices sdi {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab420d9-9be8-43f7-8c61-6a11909ec22f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bbe100-83ae-43d9-874c-8233a3542ca1]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Flushing IO for device /dev/sdi {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fb8b28-6480-4993-8efe-4d853227de42]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dee7b04-6bb3-4fdf-89c3-61fd0327c5ee]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] SCSI volumes sdi have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[de27a644-8bf8-489b-9d1a-0abd2d56caca]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd07087-a8e0-4b47-8eda-61b8331ebcf3]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586, portal: 172.16.0.220,3260]
Nov 16 15:20:09 user nova-compute[74658]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586, portal: 172.16.0.220,3260] successful.
Nov 16 15:20:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15439dd8-bb51-4dc9-977f-08bfe205a586 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67661aa-a2fd-4998-bd1d-768f947cab1d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] <== disconnect_volume: return (291ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBpxUvXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '11bd9639-1c9e-4080-bd89-bf34724684d5', 'attached_at': '', 'detached_at': '', 'volume_id': '5fdbb33e-2491-44e7-a44a-deb930f43480', 'serial'} {{(pid=74658) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 15:20:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] swap_volume: removing Cinder connection for volume 15439dd8-bb51-4dc9-977f-08bfe205a586 {{(pid=74658) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 15:20:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] swap_volume: Updating volume 15439dd8-bb51-4dc9-977f-08bfe205a586 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "eBpxUvXH", "auth_password": "XiLYZDk8ngf3Va", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "5fdbb33e-2491-44e7-a44a-deb930f43480"}, "status": "reserved", "instance": "11bd9639-1c9e-4080-bd89-bf34724684d5", "attached_at": "", "detached_at": "", "volume_id": "5fdbb33e-2491-44e7-a44a-deb930f43480", "serial": "5fdbb33e-2491-44e7-a44a-deb930f43480"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5fdbb33e-2491-44e7-a44a-deb930f43480', 'no_device': None, 'attachment_id': '47d8ca52-e3c9-4b79-8a8f-82a7ad1f58a9'} {{(pid=74658) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 15:20:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5eb7192c-f05e-40cc-8586-f81f0583d40a tempest-TestVolumeSwap-1554164614 tempest-TestVolumeSwap-1554164614-project-admin] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.904s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:11 user nova-compute[74658]: INFO nova.compute.manager [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Detaching volume 5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:20:11 user nova-compute[74658]: INFO nova.virt.block_device [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Attempting to driver detach volume 5fdbb33e-2491-44e7-a44a-deb930f43480 from mountpoint /dev/vdb
Nov 16 15:20:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Attempting to detach device vdb from instance 11bd9639-1c9e-4080-bd89-bf34724684d5 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:20:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:20:11 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:20:11 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:20:11 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:20:11 user nova-compute[74658]:   <serial>5fdbb33e-2491-44e7-a44a-deb930f43480</serial>
Nov 16 15:20:11 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:20:11 user nova-compute[74658]: </disk>
Nov 16 15:20:11 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:20:11 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Successfully detached device vdb from instance 11bd9639-1c9e-4080-bd89-bf34724684d5 from the persistent domain config.
Nov 16 15:20:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11bd9639-1c9e-4080-bd89-bf34724684d5 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:20:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:20:11 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:20:11 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:20:11 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:20:11 user nova-compute[74658]:   <serial>5fdbb33e-2491-44e7-a44a-deb930f43480</serial>
Nov 16 15:20:11 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:20:11 user nova-compute[74658]: </disk>
Nov 16 15:20:11 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:20:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11bd9639-1c9e-4080-bd89-bf34724684d5 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:20:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:19 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f is timed out.
Nov 16 15:20:19 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Successfully detached device vdb from instance 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f from the live domain config.
Nov 16 15:20:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgjGUWvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:20:19 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aecd67b-0361-471d-8bdb-190669441759]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:20:19 user nova-compute[74658]: No targets found.
Nov 16 15:20:19 user nova-compute[74658]: iSNS:
Nov 16 15:20:19 user nova-compute[74658]: No targets found.
Nov 16 15:20:19 user nova-compute[74658]: STATIC:
Nov 16 15:20:19 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:20:19 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:19 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:19 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea
Nov 16 15:20:19 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:19 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:19 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:20:19 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:19 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:19 user nova-compute[74658]: FIRMWARE:
Nov 16 15:20:19 user nova-compute[74658]: No targets found.
Nov 16 15:20:19 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:20:19 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:20:19 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[173dafef-11f5-4035-bbfe-0e605d0166c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c01b1a-990a-4ed3-b433-c0dc2dd10742]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:20:19 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:19 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:19 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea (non-flash)
Nov 16 15:20:19 user nova-compute[74658]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:19 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:19 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710103880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea'): ({'sdf'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Removing single pathed devices sdf {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec3ed39-c531-4e0c-b335-1e7a9f66bfb7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9727b5a6-197f-421c-b499-b08aec869bbe]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Flushing IO for device /dev/sdf {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7d48ea-9455-44be-8e35-270af8393824]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[978b80fe-c5b3-453a-aa79-fc7d0a7b619e]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] SCSI volumes sdf have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd63eeeb-ff59-4854-9945-24999e7622fe]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3693c1fe-dd8d-4700-a02e-fa42f9d304cb]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea, portal: 172.16.0.220,3260]
Nov 16 15:20:19 user nova-compute[74658]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea, portal: 172.16.0.220,3260] successful.
Nov 16 15:20:19 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd8eded-c9a6-45ca-bce4-9511e983a607]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] <== disconnect_volume: return (297ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG nova.objects.instance [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lazy-loading 'flavor' on Instance uuid 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6f4aeaba-b211-4a90-9d57-06b689a10186 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.795s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.642s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:20 user nova-compute[74658]: INFO nova.compute.manager [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Terminating instance
Nov 16 15:20:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-d401f454-f6b9-4b23-a03f-fda276a19caf req-cf0db66a-9c07-4156-979d-e35ba962a573 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Received event network-vif-unplugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d401f454-f6b9-4b23-a03f-fda276a19caf req-cf0db66a-9c07-4156-979d-e35ba962a573 service nova] Acquiring lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d401f454-f6b9-4b23-a03f-fda276a19caf req-cf0db66a-9c07-4156-979d-e35ba962a573 service nova] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d401f454-f6b9-4b23-a03f-fda276a19caf req-cf0db66a-9c07-4156-979d-e35ba962a573 service nova] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-d401f454-f6b9-4b23-a03f-fda276a19caf req-cf0db66a-9c07-4156-979d-e35ba962a573 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] No waiting events found dispatching network-vif-unplugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-d401f454-f6b9-4b23-a03f-fda276a19caf req-cf0db66a-9c07-4156-979d-e35ba962a573 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Received event network-vif-unplugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:20:21 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Instance destroyed successfully.
Nov 16 15:20:21 user nova-compute[74658]: DEBUG nova.objects.instance [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lazy-loading 'resources' on Instance uuid 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-642206347',display_name='tempest-VolumesSnapshotTestJSON-instance-642206347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-642206347',id=10,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYtfd9s0fNVyQHkl9Sjw1hBoS7nT/Cw9QiKoWIlbKhpmYCwAcM3asJn/PtYtMdX4nwh3WovaFAayHlCU254SdfDIfspOMCFJ+IxWNBZ8vbf6cwwuWjIFViJN0DWp9JNbA==',key_name='tempest-keypair-111195385',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19164c5a777949f790615128d2ee350c',ramdisk_id='',reservation_id='r-ordgda0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1886586727',owner_user_name='tempest-VolumesSnapshotTestJSON-1886586727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3ae2183da41421f88946b3cea996833',uuid=16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "address": "fa:16:3e:fc:a7:b2", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555621d9-35", "ovs_interfaceid": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converting VIF {"id": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "address": "fa:16:3e:fc:a7:b2", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555621d9-35", "ovs_interfaceid": "555621d9-35a8-43e8-9f3c-6c829a7fcdbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a7:b2,bridge_name='br-int',has_traffic_filtering=True,id=555621d9-35a8-43e8-9f3c-6c829a7fcdbe,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555621d9-35') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_vif [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a7:b2,bridge_name='br-int',has_traffic_filtering=True,id=555621d9-35a8-43e8-9f3c-6c829a7fcdbe,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555621d9-35') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap555621d9-35, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b15a339-9d59-41e2-b5a2-f6043ee4d392) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:20:21 user nova-compute[74658]: INFO os_vif [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a7:b2,bridge_name='br-int',has_traffic_filtering=True,id=555621d9-35a8-43e8-9f3c-6c829a7fcdbe,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555621d9-35')
Nov 16 15:20:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgjGUWvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:20:21 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdbd50a-d777-4565-8d4d-a947d8e15a8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:20:21 user nova-compute[74658]: No targets found.
Nov 16 15:20:21 user nova-compute[74658]: iSNS:
Nov 16 15:20:21 user nova-compute[74658]: No targets found.
Nov 16 15:20:21 user nova-compute[74658]: STATIC:
Nov 16 15:20:21 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:20:21 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:21 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:21 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:20:21 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:21 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:21 user nova-compute[74658]: FIRMWARE:
Nov 16 15:20:21 user nova-compute[74658]: No targets found.
Nov 16 15:20:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:20:21 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:20:21 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6015d269-89f9-4107-9609-59bf546595ea', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e5fafd-0114-41f8-a546-0145a755a0aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[422d1791-9846-4c86-847f-5b3a225e788b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:21 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:21 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0730462f80>, {}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Disconnecting from: [] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] <== disconnect_volume: return (81ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:20:21 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Deleting instance files /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f_del
Nov 16 15:20:21 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Deletion of /opt/stack/data/nova/instances/16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f_del complete
Nov 16 15:20:21 user nova-compute[74658]: INFO nova.compute.manager [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 16 15:20:21 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:20:21 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:20:22 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:20:22 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Took 1.04 seconds to deallocate network for instance.
Nov 16 15:20:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-e2d072cc-4ad0-4418-967d-e54a9cbaed52 req-e5ce33fc-ef37-4cb9-aa13-ca000347a492 service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Received event network-vif-deleted-555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:22 user nova-compute[74658]: WARNING nova.volume.cinder [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Attachment 8955738d-e7d1-42ef-8f52-480efe04a775 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8955738d-e7d1-42ef-8f52-480efe04a775. (HTTP 404) (Request-ID: req-f6c2518f-4564-4912-b68b-dfa200f2947e)
Nov 16 15:20:22 user nova-compute[74658]: INFO nova.compute.manager [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Took 0.03 seconds to detach 1 volumes for instance.
Nov 16 15:20:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:23 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:20:23 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:20:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-4be7334a-b74b-4967-8439-395118fc6ad9 req-c388b7cf-2f80-4704-bc25-faf6c6d25dab service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Received event network-vif-plugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4be7334a-b74b-4967-8439-395118fc6ad9 req-c388b7cf-2f80-4704-bc25-faf6c6d25dab service nova] Acquiring lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4be7334a-b74b-4967-8439-395118fc6ad9 req-c388b7cf-2f80-4704-bc25-faf6c6d25dab service nova] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4be7334a-b74b-4967-8439-395118fc6ad9 req-c388b7cf-2f80-4704-bc25-faf6c6d25dab service nova] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-4be7334a-b74b-4967-8439-395118fc6ad9 req-c388b7cf-2f80-4704-bc25-faf6c6d25dab service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] No waiting events found dispatching network-vif-plugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:20:23 user nova-compute[74658]: WARNING nova.compute.manager [req-4be7334a-b74b-4967-8439-395118fc6ad9 req-c388b7cf-2f80-4704-bc25-faf6c6d25dab service nova] [instance: 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f] Received unexpected event network-vif-plugged-555621d9-35a8-43e8-9f3c-6c829a7fcdbe for instance with vm_state deleted and task_state None.
Nov 16 15:20:23 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Deleted allocations for instance 16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f
Nov 16 15:20:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7a3a12dc-88c3-4ea7-921d-582dca81ab67 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "16e7212b-3b3a-47cb-86a3-fcdc2cad7f6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.650s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:20:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:20:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:20:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:20:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:32 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 11bd9639-1c9e-4080-bd89-bf34724684d5 is timed out.
Nov 16 15:20:32 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Successfully detached device vdb from instance 11bd9639-1c9e-4080-bd89-bf34724684d5 from the live domain config.
Nov 16 15:20:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBpxUvXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '5fdbb33e-2491-44e7-a44a-deb930f43480'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:20:32 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de3be9a-dea7-4563-898a-8a920bf07207]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:20:32 user nova-compute[74658]: No targets found.
Nov 16 15:20:32 user nova-compute[74658]: iSNS:
Nov 16 15:20:32 user nova-compute[74658]: No targets found.
Nov 16 15:20:32 user nova-compute[74658]: STATIC:
Nov 16 15:20:32 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480
Nov 16 15:20:32 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:32 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:32 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:20:32 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:20:32 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:20:32 user nova-compute[74658]: FIRMWARE:
Nov 16 15:20:32 user nova-compute[74658]: No targets found.
Nov 16 15:20:32 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:20:32 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:20:32 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89f20e3-9cf2-4df0-af41-65559e86a5f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b407df-4a71-476d-918f-b2a4ed9a6c43]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:32 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:32 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:32 user nova-compute[74658]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 (non-flash)
Nov 16 15:20:32 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07300ad120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f45df0-d86e-4c97-abbb-5065bb2dd67d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e929e636-f9dc-41a3-81c6-7565d5e1a6c7]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd711ceb-7480-4453-ba46-722da4b13a91]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[665fbb1c-820b-46a8-a9da-8d503bd10f01]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6990c445-f925-4309-891f-bc9a95c89362]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bc5167-8c6c-43c4-bcca-fb400bb6ddbe]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260]
Nov 16 15:20:32 user nova-compute[74658]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480, portal: 172.16.0.220,3260] successful.
Nov 16 15:20:32 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fdbb33e-2491-44e7-a44a-deb930f43480 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87b72eb-b30d-423e-92ff-8e993e9bec1b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] <== disconnect_volume: return (296ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:20:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:20:33 user nova-compute[74658]: DEBUG nova.objects.instance [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lazy-loading 'flavor' on Instance uuid 11bd9639-1c9e-4080-bd89-bf34724684d5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d23679d8-40f6-4793-b38f-95db779b1e9f tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.613s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Acquiring lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Acquiring lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:35 user nova-compute[74658]: INFO nova.compute.manager [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Terminating instance
Nov 16 15:20:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:20:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:36 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Instance destroyed successfully.
Nov 16 15:20:36 user nova-compute[74658]: DEBUG nova.objects.instance [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lazy-loading 'resources' on Instance uuid a2f77c43-8afd-465a-bb09-537cc3c6461d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1723290884',display_name='tempest-VolumesAssistedSnapshotsTest-server-1723290884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1723290884',id=9,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZXL7ifukTlpXpqn0smbXZ2XqRTlW0z/I/At2rpOsKzWHZpzoaYNzKeWgtQBpz+3h7r89goVsFMSWRbPxIyLOKs9aq0rULiXLbeBQszwKQWS3R0wCdyTU8CZSmkAbAiSA==',key_name='tempest-keypair-45209290',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='178e7561b73544a284db0720f88a0fb6',ramdisk_id='',reservation_id='r-fq10my64',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1418335071',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1418335071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbde6e05279e4dd5b7d854bbab2c1e50',uuid=a2f77c43-8afd-465a-bb09-537cc3c6461d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f8f9aea-261c-4e66-a187-93378644d1eb", "address": "fa:16:3e:0e:8b:db", "network": {"id": "c4338e19-e8b4-4395-8709-98a16689c81e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688938605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "178e7561b73544a284db0720f88a0fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8f9aea-26", "ovs_interfaceid": "2f8f9aea-261c-4e66-a187-93378644d1eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Converting VIF {"id": "2f8f9aea-261c-4e66-a187-93378644d1eb", "address": "fa:16:3e:0e:8b:db", "network": {"id": "c4338e19-e8b4-4395-8709-98a16689c81e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688938605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "178e7561b73544a284db0720f88a0fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8f9aea-26", "ovs_interfaceid": "2f8f9aea-261c-4e66-a187-93378644d1eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:8b:db,bridge_name='br-int',has_traffic_filtering=True,id=2f8f9aea-261c-4e66-a187-93378644d1eb,network=Network(c4338e19-e8b4-4395-8709-98a16689c81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8f9aea-26') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG os_vif [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:8b:db,bridge_name='br-int',has_traffic_filtering=True,id=2f8f9aea-261c-4e66-a187-93378644d1eb,network=Network(c4338e19-e8b4-4395-8709-98a16689c81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8f9aea-26') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f8f9aea-26, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcd13afb-43ff-41c0-9a0e-adf58bed25fe) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:36 user nova-compute[74658]: INFO os_vif [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:8b:db,bridge_name='br-int',has_traffic_filtering=True,id=2f8f9aea-261c-4e66-a187-93378644d1eb,network=Network(c4338e19-e8b4-4395-8709-98a16689c81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8f9aea-26')
Nov 16 15:20:36 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Deleting instance files /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d_del
Nov 16 15:20:36 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Deletion of /opt/stack/data/nova/instances/a2f77c43-8afd-465a-bb09-537cc3c6461d_del complete
Nov 16 15:20:36 user nova-compute[74658]: INFO nova.compute.manager [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 15:20:36 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:20:36 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:20:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-042848da-74a9-4c95-909b-717362b6901b req-d108b196-c0ab-47df-9c3f-4ece7c18c881 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Received event network-vif-unplugged-2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-042848da-74a9-4c95-909b-717362b6901b req-d108b196-c0ab-47df-9c3f-4ece7c18c881 service nova] Acquiring lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-042848da-74a9-4c95-909b-717362b6901b req-d108b196-c0ab-47df-9c3f-4ece7c18c881 service nova] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-042848da-74a9-4c95-909b-717362b6901b req-d108b196-c0ab-47df-9c3f-4ece7c18c881 service nova] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-042848da-74a9-4c95-909b-717362b6901b req-d108b196-c0ab-47df-9c3f-4ece7c18c881 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] No waiting events found dispatching network-vif-unplugged-2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:20:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-042848da-74a9-4c95-909b-717362b6901b req-d108b196-c0ab-47df-9c3f-4ece7c18c881 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Received event network-vif-unplugged-2f8f9aea-261c-4e66-a187-93378644d1eb for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:20:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:37 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:20:37 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Took 1.28 seconds to deallocate network for instance.
Nov 16 15:20:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-016c9df8-7799-4b04-b72f-a1c433442011 req-1ce4972c-3de6-4c0f-bd32-99a70dfde8a2 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Received event network-vif-deleted-2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:37 user nova-compute[74658]: INFO nova.compute.manager [req-016c9df8-7799-4b04-b72f-a1c433442011 req-1ce4972c-3de6-4c0f-bd32-99a70dfde8a2 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Neutron deleted interface 2f8f9aea-261c-4e66-a187-93378644d1eb; detaching it from the instance and deleting it from the info cache
Nov 16 15:20:37 user nova-compute[74658]: DEBUG nova.network.neutron [req-016c9df8-7799-4b04-b72f-a1c433442011 req-1ce4972c-3de6-4c0f-bd32-99a70dfde8a2 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:20:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-016c9df8-7799-4b04-b72f-a1c433442011 req-1ce4972c-3de6-4c0f-bd32-99a70dfde8a2 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Detach interface failed, port_id=2f8f9aea-261c-4e66-a187-93378644d1eb, reason: Instance a2f77c43-8afd-465a-bb09-537cc3c6461d could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:20:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:38 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:20:38 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:20:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.839s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:38 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Deleted allocations for instance a2f77c43-8afd-465a-bb09-537cc3c6461d
Nov 16 15:20:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-84b74c83-1c87-4433-8754-a134187047fa tempest-VolumesAssistedSnapshotsTest-1418335071 tempest-VolumesAssistedSnapshotsTest-1418335071-project-member] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.179s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-664403db-5dfe-4b4f-8da8-0fa01a502a16 req-ba250aef-6de1-429a-9ff9-b1aa88f62797 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Received event network-vif-plugged-2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-664403db-5dfe-4b4f-8da8-0fa01a502a16 req-ba250aef-6de1-429a-9ff9-b1aa88f62797 service nova] Acquiring lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-664403db-5dfe-4b4f-8da8-0fa01a502a16 req-ba250aef-6de1-429a-9ff9-b1aa88f62797 service nova] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-664403db-5dfe-4b4f-8da8-0fa01a502a16 req-ba250aef-6de1-429a-9ff9-b1aa88f62797 service nova] Lock "a2f77c43-8afd-465a-bb09-537cc3c6461d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-664403db-5dfe-4b4f-8da8-0fa01a502a16 req-ba250aef-6de1-429a-9ff9-b1aa88f62797 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] No waiting events found dispatching network-vif-plugged-2f8f9aea-261c-4e66-a187-93378644d1eb {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:20:39 user nova-compute[74658]: WARNING nova.compute.manager [req-664403db-5dfe-4b4f-8da8-0fa01a502a16 req-ba250aef-6de1-429a-9ff9-b1aa88f62797 service nova] [instance: a2f77c43-8afd-465a-bb09-537cc3c6461d] Received unexpected event network-vif-plugged-2f8f9aea-261c-4e66-a187-93378644d1eb for instance with vm_state deleted and task_state None.
Nov 16 15:20:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "7a8d82d1-5263-472d-8491-1abc709404dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "7a8d82d1-5263-472d-8491-1abc709404dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:45 user nova-compute[74658]: INFO nova.compute.manager [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Terminating instance
Nov 16 15:20:45 user nova-compute[74658]: DEBUG nova.compute.manager [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Acquiring lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-136f1117-378c-47b3-9881-fad07a765234 req-f92e8907-f080-4dc3-99df-3d75a7727bc4 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Received event network-vif-unplugged-4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-136f1117-378c-47b3-9881-fad07a765234 req-f92e8907-f080-4dc3-99df-3d75a7727bc4 service nova] Acquiring lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-136f1117-378c-47b3-9881-fad07a765234 req-f92e8907-f080-4dc3-99df-3d75a7727bc4 service nova] Lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-136f1117-378c-47b3-9881-fad07a765234 req-f92e8907-f080-4dc3-99df-3d75a7727bc4 service nova] Lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-136f1117-378c-47b3-9881-fad07a765234 req-f92e8907-f080-4dc3-99df-3d75a7727bc4 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] No waiting events found dispatching network-vif-unplugged-4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-136f1117-378c-47b3-9881-fad07a765234 req-f92e8907-f080-4dc3-99df-3d75a7727bc4 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Received event network-vif-unplugged-4f55927a-4754-4029-af3f-a5758d8d1793 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:20:45 user nova-compute[74658]: INFO nova.compute.claims [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Claim successful on node user
Nov 16 15:20:46 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Instance destroyed successfully.
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.objects.instance [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lazy-loading 'resources' on Instance uuid 7a8d82d1-5263-472d-8491-1abc709404dd {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2077344507',display_name='tempest-ServersNegativeTestJSON-server-2077344507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2077344507',id=12,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:19:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af743d7342e44f64ae98c2d596eb63b1',ramdisk_id='',reservation_id='r-b0ava4km',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-143070094',owner_user_name='tempest-ServersNegativeTestJSON-143070094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:19:02Z,user_data=None,user_id='d3ab7f89ab8d49c2a0f526c4c09a3b94',uuid=7a8d82d1-5263-472d-8491-1abc709404dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f55927a-4754-4029-af3f-a5758d8d1793", "address": "fa:16:3e:0e:9e:7a", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f55927a-47", "ovs_interfaceid": "4f55927a-4754-4029-af3f-a5758d8d1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converting VIF {"id": "4f55927a-4754-4029-af3f-a5758d8d1793", "address": "fa:16:3e:0e:9e:7a", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f55927a-47", "ovs_interfaceid": "4f55927a-4754-4029-af3f-a5758d8d1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:9e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f55927a-4754-4029-af3f-a5758d8d1793,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f55927a-47') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG os_vif [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:9e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f55927a-4754-4029-af3f-a5758d8d1793,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f55927a-47') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f55927a-47, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46c17903-eae4-485e-af96-632688aeb65d) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:20:46 user nova-compute[74658]: INFO os_vif [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:9e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f55927a-4754-4029-af3f-a5758d8d1793,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f55927a-47')
Nov 16 15:20:46 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Deleting instance files /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd_del
Nov 16 15:20:46 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Deletion of /opt/stack/data/nova/instances/7a8d82d1-5263-472d-8491-1abc709404dd_del complete
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:20:46 user nova-compute[74658]: INFO nova.compute.manager [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 16 15:20:46 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:20:46 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.policy [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c0dab3698614bc6928b9b24a3d8be5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd769ec72d94d5aa1a2e5f7274b985c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:20:46 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Creating image(s)
Nov 16 15:20:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Acquiring lock "/opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "/opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "/opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.211s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:20:46 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Took 0.66 seconds to deallocate network for instance.
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-899adf04-8c9e-4314-9fdd-750c7a925c27 req-2df91ca4-09d0-4d3e-86cb-5aceff1c6ef3 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Received event network-vif-deleted-4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:46 user nova-compute[74658]: INFO nova.compute.manager [req-899adf04-8c9e-4314-9fdd-750c7a925c27 req-2df91ca4-09d0-4d3e-86cb-5aceff1c6ef3 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Neutron deleted interface 4f55927a-4754-4029-af3f-a5758d8d1793; detaching it from the instance and deleting it from the info cache
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.network.neutron [req-899adf04-8c9e-4314-9fdd-750c7a925c27 req-2df91ca4-09d0-4d3e-86cb-5aceff1c6ef3 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:20:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-899adf04-8c9e-4314-9fdd-750c7a925c27 req-2df91ca4-09d0-4d3e-86cb-5aceff1c6ef3 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Detach interface failed, port_id=4f55927a-4754-4029-af3f-a5758d8d1793, reason: Instance 7a8d82d1-5263-472d-8491-1abc709404dd could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.198s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk 1073741824" returned: 0 in 0.070s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Successfully created port: ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Cannot resize image /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Ensure instance console log exists: /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:47 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Deleted allocations for instance 7a8d82d1-5263-472d-8491-1abc709404dd
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bbc0f215-ecb5-4905-94a5-1db664acbbcc tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "7a8d82d1-5263-472d-8491-1abc709404dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.391s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-a2c9802a-f02d-4779-97a2-1aa678cac1bc req-9d3fa07c-0127-44e6-a3c5-1779d1659a00 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Received event network-vif-plugged-4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a2c9802a-f02d-4779-97a2-1aa678cac1bc req-9d3fa07c-0127-44e6-a3c5-1779d1659a00 service nova] Acquiring lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a2c9802a-f02d-4779-97a2-1aa678cac1bc req-9d3fa07c-0127-44e6-a3c5-1779d1659a00 service nova] Lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a2c9802a-f02d-4779-97a2-1aa678cac1bc req-9d3fa07c-0127-44e6-a3c5-1779d1659a00 service nova] Lock "7a8d82d1-5263-472d-8491-1abc709404dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-a2c9802a-f02d-4779-97a2-1aa678cac1bc req-9d3fa07c-0127-44e6-a3c5-1779d1659a00 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] No waiting events found dispatching network-vif-plugged-4f55927a-4754-4029-af3f-a5758d8d1793 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:20:47 user nova-compute[74658]: WARNING nova.compute.manager [req-a2c9802a-f02d-4779-97a2-1aa678cac1bc req-9d3fa07c-0127-44e6-a3c5-1779d1659a00 service nova] [instance: 7a8d82d1-5263-472d-8491-1abc709404dd] Received unexpected event network-vif-plugged-4f55927a-4754-4029-af3f-a5758d8d1793 for instance with vm_state deleted and task_state None.
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Successfully updated port: ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Acquiring lock "refresh_cache-020c2d27-cb9b-4624-acea-e3e4446ccbfe" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Acquired lock "refresh_cache-020c2d27-cb9b-4624-acea-e3e4446ccbfe" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-db4915e6-85e3-4c76-96ab-3162173e7ff4 req-28d8ccb8-d2b3-485d-a759-db0b8f2180dd service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Received event network-changed-ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-db4915e6-85e3-4c76-96ab-3162173e7ff4 req-28d8ccb8-d2b3-485d-a759-db0b8f2180dd service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Refreshing instance network info cache due to event network-changed-ad4bb213-69cc-428a-ba46-504e6ba69ca0. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db4915e6-85e3-4c76-96ab-3162173e7ff4 req-28d8ccb8-d2b3-485d-a759-db0b8f2180dd service nova] Acquiring lock "refresh_cache-020c2d27-cb9b-4624-acea-e3e4446ccbfe" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:20:47 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Updating instance_info_cache with network_info: [{"id": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "address": "fa:16:3e:48:11:73", "network": {"id": "fd45699b-227b-4ade-a66e-6bf1f5c6f371", "bridge": "br-int", "label": "tempest-VolumesActionsTest-692037496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bd769ec72d94d5aa1a2e5f7274b985c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4bb213-69", "ovs_interfaceid": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:20:48 user nova-compute[74658]: INFO nova.compute.claims [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Claim successful on node user
Nov 16 15:20:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Releasing lock "refresh_cache-020c2d27-cb9b-4624-acea-e3e4446ccbfe" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Instance network_info: |[{"id": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "address": "fa:16:3e:48:11:73", "network": {"id": "fd45699b-227b-4ade-a66e-6bf1f5c6f371", "bridge": "br-int", "label": "tempest-VolumesActionsTest-692037496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bd769ec72d94d5aa1a2e5f7274b985c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4bb213-69", "ovs_interfaceid": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db4915e6-85e3-4c76-96ab-3162173e7ff4 req-28d8ccb8-d2b3-485d-a759-db0b8f2180dd service nova] Acquired lock "refresh_cache-020c2d27-cb9b-4624-acea-e3e4446ccbfe" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.network.neutron [req-db4915e6-85e3-4c76-96ab-3162173e7ff4 req-28d8ccb8-d2b3-485d-a759-db0b8f2180dd service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Refreshing network info cache for port ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Start _get_guest_xml network_info=[{"id": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "address": "fa:16:3e:48:11:73", "network": {"id": "fd45699b-227b-4ade-a66e-6bf1f5c6f371", "bridge": "br-int", "label": "tempest-VolumesActionsTest-692037496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bd769ec72d94d5aa1a2e5f7274b985c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4bb213-69", "ovs_interfaceid": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:20:48 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:20:48 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1385212368',display_name='tempest-VolumesActionsTest-instance-1385212368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1385212368',id=13,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bd769ec72d94d5aa1a2e5f7274b985c',ramdisk_id='',reservation_id='r-92mh2ogj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1040536036',owner_user_name='tempest-VolumesActionsTest-1040536036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:20:47Z,user_data=None,user_id='0c0dab3698614bc6928b9b24a3d8be5f',uuid=020c2d27-cb9b-4624-acea-e3e4446ccbfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "address": "fa:16:3e:48:11:73", "network": {"id": "fd45699b-227b-4ade-a66e-6bf1f5c6f371", "bridge": "br-int", "label": "tempest-VolumesActionsTest-692037496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bd769ec72d94d5aa1a2e5f7274b985c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4bb213-69", "ovs_interfaceid": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Converting VIF {"id": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "address": "fa:16:3e:48:11:73", "network": {"id": "fd45699b-227b-4ade-a66e-6bf1f5c6f371", "bridge": "br-int", "label": "tempest-VolumesActionsTest-692037496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bd769ec72d94d5aa1a2e5f7274b985c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4bb213-69", "ovs_interfaceid": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:11:73,bridge_name='br-int',has_traffic_filtering=True,id=ad4bb213-69cc-428a-ba46-504e6ba69ca0,network=Network(fd45699b-227b-4ade-a66e-6bf1f5c6f371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4bb213-69') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lazy-loading 'pci_devices' on Instance uuid 020c2d27-cb9b-4624-acea-e3e4446ccbfe {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:20:48 user nova-compute[74658]:   <uuid>020c2d27-cb9b-4624-acea-e3e4446ccbfe</uuid>
Nov 16 15:20:48 user nova-compute[74658]:   <name>instance-0000000d</name>
Nov 16 15:20:48 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:20:48 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:20:48 user nova-compute[74658]:   <metadata>
Nov 16 15:20:48 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:20:48 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:20:48 user nova-compute[74658]:       <nova:name>tempest-VolumesActionsTest-instance-1385212368</nova:name>
Nov 16 15:20:48 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:20:48</nova:creationTime>
Nov 16 15:20:48 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:20:48 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:20:48 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:20:48 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:20:48 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:20:48 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:20:48 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:20:48 user nova-compute[74658]:       <nova:owner>
Nov 16 15:20:48 user nova-compute[74658]:         <nova:user uuid="0c0dab3698614bc6928b9b24a3d8be5f">tempest-VolumesActionsTest-1040536036-project-member</nova:user>
Nov 16 15:20:48 user nova-compute[74658]:         <nova:project uuid="3bd769ec72d94d5aa1a2e5f7274b985c">tempest-VolumesActionsTest-1040536036</nova:project>
Nov 16 15:20:48 user nova-compute[74658]:       </nova:owner>
Nov 16 15:20:48 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:20:48 user nova-compute[74658]:       <nova:ports>
Nov 16 15:20:48 user nova-compute[74658]:         <nova:port uuid="ad4bb213-69cc-428a-ba46-504e6ba69ca0">
Nov 16 15:20:48 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 15:20:48 user nova-compute[74658]:         </nova:port>
Nov 16 15:20:48 user nova-compute[74658]:       </nova:ports>
Nov 16 15:20:48 user nova-compute[74658]:     </nova:instance>
Nov 16 15:20:48 user nova-compute[74658]:   </metadata>
Nov 16 15:20:48 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:20:48 user nova-compute[74658]:     <system>
Nov 16 15:20:48 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:20:48 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:20:48 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:20:48 user nova-compute[74658]:       <entry name="serial">020c2d27-cb9b-4624-acea-e3e4446ccbfe</entry>
Nov 16 15:20:48 user nova-compute[74658]:       <entry name="uuid">020c2d27-cb9b-4624-acea-e3e4446ccbfe</entry>
Nov 16 15:20:48 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:20:48 user nova-compute[74658]:     </system>
Nov 16 15:20:48 user nova-compute[74658]:   </sysinfo>
Nov 16 15:20:48 user nova-compute[74658]:   <os>
Nov 16 15:20:48 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:20:48 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:20:48 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:20:48 user nova-compute[74658]:   </os>
Nov 16 15:20:48 user nova-compute[74658]:   <features>
Nov 16 15:20:48 user nova-compute[74658]:     <acpi/>
Nov 16 15:20:48 user nova-compute[74658]:     <apic/>
Nov 16 15:20:48 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:20:48 user nova-compute[74658]:   </features>
Nov 16 15:20:48 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:20:48 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:20:48 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:20:48 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:20:48 user nova-compute[74658]:   </clock>
Nov 16 15:20:48 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:20:48 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:20:48 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:20:48 user nova-compute[74658]:   </cpu>
Nov 16 15:20:48 user nova-compute[74658]:   <devices>
Nov 16 15:20:48 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:20:48 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:20:48 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk"/>
Nov 16 15:20:48 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:20:48 user nova-compute[74658]:     </disk>
Nov 16 15:20:48 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:20:48 user nova-compute[74658]:       <mac address="fa:16:3e:48:11:73"/>
Nov 16 15:20:48 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:20:48 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:20:48 user nova-compute[74658]:       <target dev="tapad4bb213-69"/>
Nov 16 15:20:48 user nova-compute[74658]:     </interface>
Nov 16 15:20:48 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:20:48 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/console.log" append="off"/>
Nov 16 15:20:48 user nova-compute[74658]:     </serial>
Nov 16 15:20:48 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:20:48 user nova-compute[74658]:     <video>
Nov 16 15:20:48 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:20:48 user nova-compute[74658]:     </video>
Nov 16 15:20:48 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:20:48 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:20:48 user nova-compute[74658]:     </rng>
Nov 16 15:20:48 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:20:48 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:20:48 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:20:48 user nova-compute[74658]:     </memballoon>
Nov 16 15:20:48 user nova-compute[74658]:   </devices>
Nov 16 15:20:48 user nova-compute[74658]: </domain>
Nov 16 15:20:48 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1385212368',display_name='tempest-VolumesActionsTest-instance-1385212368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1385212368',id=13,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bd769ec72d94d5aa1a2e5f7274b985c',ramdisk_id='',reservation_id='r-92mh2ogj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1040536036',owner_user_name='tempest-VolumesActionsTest-1040536036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:20:47Z,user_data=None,user_id='0c0dab3698614bc6928b9b24a3d8be5f',uuid=020c2d27-cb9b-4624-acea-e3e4446ccbfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "address": "fa:16:3e:48:11:73", "network": {"id": "fd45699b-227b-4ade-a66e-6bf1f5c6f371", "bridge": "br-int", "label": "tempest-VolumesActionsTest-692037496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bd769ec72d94d5aa1a2e5f7274b985c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4bb213-69", "ovs_interfaceid": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Converting VIF {"id": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "address": "fa:16:3e:48:11:73", "network": {"id": "fd45699b-227b-4ade-a66e-6bf1f5c6f371", "bridge": "br-int", "label": "tempest-VolumesActionsTest-692037496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bd769ec72d94d5aa1a2e5f7274b985c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4bb213-69", "ovs_interfaceid": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:11:73,bridge_name='br-int',has_traffic_filtering=True,id=ad4bb213-69cc-428a-ba46-504e6ba69ca0,network=Network(fd45699b-227b-4ade-a66e-6bf1f5c6f371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4bb213-69') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG os_vif [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:11:73,bridge_name='br-int',has_traffic_filtering=True,id=ad4bb213-69cc-428a-ba46-504e6ba69ca0,network=Network(fd45699b-227b-4ade-a66e-6bf1f5c6f371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4bb213-69') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a597a7e4-b5c2-5357-9b93-3c41f2bbcad3', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad4bb213-69, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad4bb213-69, col_values=(('qos', UUID('40eda682-44b0-4751-98d8-839046ea15ea')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad4bb213-69, col_values=(('external_ids', {'iface-id': 'ad4bb213-69cc-428a-ba46-504e6ba69ca0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:11:73', 'vm-uuid': '020c2d27-cb9b-4624-acea-e3e4446ccbfe'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:48 user nova-compute[74658]: INFO os_vif [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:11:73,bridge_name='br-int',has_traffic_filtering=True,id=ad4bb213-69cc-428a-ba46-504e6ba69ca0,network=Network(fd45699b-227b-4ade-a66e-6bf1f5c6f371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4bb213-69')
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] No VIF found with MAC fa:16:3e:48:11:73, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.network.neutron [req-db4915e6-85e3-4c76-96ab-3162173e7ff4 req-28d8ccb8-d2b3-485d-a759-db0b8f2180dd service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Updated VIF entry in instance network info cache for port ad4bb213-69cc-428a-ba46-504e6ba69ca0. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.network.neutron [req-db4915e6-85e3-4c76-96ab-3162173e7ff4 req-28d8ccb8-d2b3-485d-a759-db0b8f2180dd service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Updating instance_info_cache with network_info: [{"id": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "address": "fa:16:3e:48:11:73", "network": {"id": "fd45699b-227b-4ade-a66e-6bf1f5c6f371", "bridge": "br-int", "label": "tempest-VolumesActionsTest-692037496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bd769ec72d94d5aa1a2e5f7274b985c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4bb213-69", "ovs_interfaceid": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db4915e6-85e3-4c76-96ab-3162173e7ff4 req-28d8ccb8-d2b3-485d-a759-db0b8f2180dd service nova] Releasing lock "refresh_cache-020c2d27-cb9b-4624-acea-e3e4446ccbfe" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.network.neutron [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:20:48 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:20:48 user nova-compute[74658]: DEBUG nova.policy [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8507e72d5b248cd8a6a8b9bea6733cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b189fdeea224d4dbdc2923041dc8e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG nova.compute.manager [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:20:49 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Creating image(s)
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "/opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "/opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'flavor' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.194s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:49 user nova-compute[74658]: INFO nova.compute.manager [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Attaching volume 1e38a4c3-f416-4157-9c21-063e29002b7d to /dev/vdb
Nov 16 15:20:49 user nova-compute[74658]: DEBUG os_brick.utils [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.210s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9746c8-464a-47bb-9244-197898d165c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk 1073741824" returned: 0 in 0.054s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa0328-6c9e-4642-b957-5c05e2cc80ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[90deed7c-73be-468a-900e-e84f49683f4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2090fcbc-7b56-402f-a4f0-6947ccbd07e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:20:49 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f51c0-05d5-4858-af9b-1361cdfa2d6b]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG os_brick.utils [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updating existing volume attachment record: b785d22b-b72e-419f-a652-3868ab037433 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG nova.network.neutron [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Successfully created port: 7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.231s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Cannot resize image /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Ensure instance console log exists: /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.008s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-78d16d77-fa23-4561-b4a3-fffd276b57fb req-74564837-be8c-4df8-9efb-da18b13ada98 service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Received event network-vif-plugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78d16d77-fa23-4561-b4a3-fffd276b57fb req-74564837-be8c-4df8-9efb-da18b13ada98 service nova] Acquiring lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78d16d77-fa23-4561-b4a3-fffd276b57fb req-74564837-be8c-4df8-9efb-da18b13ada98 service nova] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78d16d77-fa23-4561-b4a3-fffd276b57fb req-74564837-be8c-4df8-9efb-da18b13ada98 service nova] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-78d16d77-fa23-4561-b4a3-fffd276b57fb req-74564837-be8c-4df8-9efb-da18b13ada98 service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] No waiting events found dispatching network-vif-plugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:20:50 user nova-compute[74658]: WARNING nova.compute.manager [req-78d16d77-fa23-4561-b4a3-fffd276b57fb req-74564837-be8c-4df8-9efb-da18b13ada98 service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Received unexpected event network-vif-plugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 for instance with vm_state building and task_state spawning.
Nov 16 15:20:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.network.neutron [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Successfully updated port: 7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "refresh_cache-e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquired lock "refresh_cache-e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.network.neutron [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8a97fb7-36d0-4a33-bf53-c6f17b31f94e req-d12102ce-4306-43be-8ad1-7f8213ba54a4 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-changed-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8a97fb7-36d0-4a33-bf53-c6f17b31f94e req-d12102ce-4306-43be-8ad1-7f8213ba54a4 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Refreshing instance network info cache due to event network-changed-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8a97fb7-36d0-4a33-bf53-c6f17b31f94e req-d12102ce-4306-43be-8ad1-7f8213ba54a4 service nova] Acquiring lock "refresh_cache-e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.network.neutron [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.network.neutron [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Updating instance_info_cache with network_info: [{"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Releasing lock "refresh_cache-e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.compute.manager [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Instance network_info: |[{"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8a97fb7-36d0-4a33-bf53-c6f17b31f94e req-d12102ce-4306-43be-8ad1-7f8213ba54a4 service nova] Acquired lock "refresh_cache-e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.network.neutron [req-a8a97fb7-36d0-4a33-bf53-c6f17b31f94e req-d12102ce-4306-43be-8ad1-7f8213ba54a4 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Refreshing network info cache for port 7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Start _get_guest_xml network_info=[{"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:20:51 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:20:51 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-973719147',display_name='tempest-tempest.common.compute-instance-973719147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-973719147',id=14,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl++RKbB4aUMtrYmCOPdauQa/gpN9opiKUp/X+UapEvp1+7Y6F8dw6oyEwiFoEntT82tpQ3YHK6HAURo3UVwXD4GvU0Ji0v1dRcPaNdtl8esG6M51w55UWC2mDAZTpGjw==',key_name='tempest-keypair-851894490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-kms34bsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=e1a0ba07-9784-4984-a0a2-4dd1d55cb53d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.objects.instance [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'pci_devices' on Instance uuid e1a0ba07-9784-4984-a0a2-4dd1d55cb53d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:20:51 user nova-compute[74658]:   <uuid>e1a0ba07-9784-4984-a0a2-4dd1d55cb53d</uuid>
Nov 16 15:20:51 user nova-compute[74658]:   <name>instance-0000000e</name>
Nov 16 15:20:51 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:20:51 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:20:51 user nova-compute[74658]:   <metadata>
Nov 16 15:20:51 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:20:51 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:20:51 user nova-compute[74658]:       <nova:name>tempest-tempest.common.compute-instance-973719147</nova:name>
Nov 16 15:20:51 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:20:51</nova:creationTime>
Nov 16 15:20:51 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:20:51 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:20:51 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:20:51 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:20:51 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:20:51 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:20:51 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:20:51 user nova-compute[74658]:       <nova:owner>
Nov 16 15:20:51 user nova-compute[74658]:         <nova:user uuid="d8507e72d5b248cd8a6a8b9bea6733cb">tempest-ServerActionsTestOtherA-1362925052-project-member</nova:user>
Nov 16 15:20:51 user nova-compute[74658]:         <nova:project uuid="6b189fdeea224d4dbdc2923041dc8e75">tempest-ServerActionsTestOtherA-1362925052</nova:project>
Nov 16 15:20:51 user nova-compute[74658]:       </nova:owner>
Nov 16 15:20:51 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:20:51 user nova-compute[74658]:       <nova:ports>
Nov 16 15:20:51 user nova-compute[74658]:         <nova:port uuid="7cd5fe13-ad8c-4d41-9e1e-09d269fd8685">
Nov 16 15:20:51 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 15:20:51 user nova-compute[74658]:         </nova:port>
Nov 16 15:20:51 user nova-compute[74658]:       </nova:ports>
Nov 16 15:20:51 user nova-compute[74658]:     </nova:instance>
Nov 16 15:20:51 user nova-compute[74658]:   </metadata>
Nov 16 15:20:51 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:20:51 user nova-compute[74658]:     <system>
Nov 16 15:20:51 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:20:51 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:20:51 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:20:51 user nova-compute[74658]:       <entry name="serial">e1a0ba07-9784-4984-a0a2-4dd1d55cb53d</entry>
Nov 16 15:20:51 user nova-compute[74658]:       <entry name="uuid">e1a0ba07-9784-4984-a0a2-4dd1d55cb53d</entry>
Nov 16 15:20:51 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:20:51 user nova-compute[74658]:     </system>
Nov 16 15:20:51 user nova-compute[74658]:   </sysinfo>
Nov 16 15:20:51 user nova-compute[74658]:   <os>
Nov 16 15:20:51 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:20:51 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:20:51 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:20:51 user nova-compute[74658]:   </os>
Nov 16 15:20:51 user nova-compute[74658]:   <features>
Nov 16 15:20:51 user nova-compute[74658]:     <acpi/>
Nov 16 15:20:51 user nova-compute[74658]:     <apic/>
Nov 16 15:20:51 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:20:51 user nova-compute[74658]:   </features>
Nov 16 15:20:51 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:20:51 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:20:51 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:20:51 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:20:51 user nova-compute[74658]:   </clock>
Nov 16 15:20:51 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:20:51 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:20:51 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:20:51 user nova-compute[74658]:   </cpu>
Nov 16 15:20:51 user nova-compute[74658]:   <devices>
Nov 16 15:20:51 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:20:51 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:20:51 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk"/>
Nov 16 15:20:51 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:20:51 user nova-compute[74658]:     </disk>
Nov 16 15:20:51 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:20:51 user nova-compute[74658]:       <mac address="fa:16:3e:67:46:cc"/>
Nov 16 15:20:51 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:20:51 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:20:51 user nova-compute[74658]:       <target dev="tap7cd5fe13-ad"/>
Nov 16 15:20:51 user nova-compute[74658]:     </interface>
Nov 16 15:20:51 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:20:51 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/console.log" append="off"/>
Nov 16 15:20:51 user nova-compute[74658]:     </serial>
Nov 16 15:20:51 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:20:51 user nova-compute[74658]:     <video>
Nov 16 15:20:51 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:20:51 user nova-compute[74658]:     </video>
Nov 16 15:20:51 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:20:51 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:20:51 user nova-compute[74658]:     </rng>
Nov 16 15:20:51 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:20:51 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:20:51 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:20:51 user nova-compute[74658]:     </memballoon>
Nov 16 15:20:51 user nova-compute[74658]:   </devices>
Nov 16 15:20:51 user nova-compute[74658]: </domain>
Nov 16 15:20:51 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-973719147',display_name='tempest-tempest.common.compute-instance-973719147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-973719147',id=14,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl++RKbB4aUMtrYmCOPdauQa/gpN9opiKUp/X+UapEvp1+7Y6F8dw6oyEwiFoEntT82tpQ3YHK6HAURo3UVwXD4GvU0Ji0v1dRcPaNdtl8esG6M51w55UWC2mDAZTpGjw==',key_name='tempest-keypair-851894490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-kms34bsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=e1a0ba07-9784-4984-a0a2-4dd1d55cb53d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG os_vif [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b54aef80-4ec3-5081-864c-3ee158294c7d', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cd5fe13-ad, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cd5fe13-ad, col_values=(('qos', UUID('2139beeb-4c6a-499e-b89c-e95ce36060a0')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cd5fe13-ad, col_values=(('external_ids', {'iface-id': '7cd5fe13-ad8c-4d41-9e1e-09d269fd8685', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:46:cc', 'vm-uuid': 'e1a0ba07-9784-4984-a0a2-4dd1d55cb53d'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:20:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:51 user nova-compute[74658]: INFO os_vif [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad')
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No VIF found with MAC fa:16:3e:67:46:cc, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.network.neutron [req-a8a97fb7-36d0-4a33-bf53-c6f17b31f94e req-d12102ce-4306-43be-8ad1-7f8213ba54a4 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Updated VIF entry in instance network info cache for port 7cd5fe13-ad8c-4d41-9e1e-09d269fd8685. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.network.neutron [req-a8a97fb7-36d0-4a33-bf53-c6f17b31f94e req-d12102ce-4306-43be-8ad1-7f8213ba54a4 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Updating instance_info_cache with network_info: [{"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8a97fb7-36d0-4a33-bf53-c6f17b31f94e req-d12102ce-4306-43be-8ad1-7f8213ba54a4 service nova] Releasing lock "refresh_cache-e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:20:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Instance spawned successfully.
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-483e289d-e0b8-433a-b4eb-aa3b6e64d1ae req-d9db958a-c5d5-42cc-9e5b-83299d9aef73 service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Received event network-vif-plugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-483e289d-e0b8-433a-b4eb-aa3b6e64d1ae req-d9db958a-c5d5-42cc-9e5b-83299d9aef73 service nova] Acquiring lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-483e289d-e0b8-433a-b4eb-aa3b6e64d1ae req-d9db958a-c5d5-42cc-9e5b-83299d9aef73 service nova] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-483e289d-e0b8-433a-b4eb-aa3b6e64d1ae req-d9db958a-c5d5-42cc-9e5b-83299d9aef73 service nova] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-483e289d-e0b8-433a-b4eb-aa3b6e64d1ae req-d9db958a-c5d5-42cc-9e5b-83299d9aef73 service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] No waiting events found dispatching network-vif-plugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:20:52 user nova-compute[74658]: WARNING nova.compute.manager [req-483e289d-e0b8-433a-b4eb-aa3b6e64d1ae req-d9db958a-c5d5-42cc-9e5b-83299d9aef73 service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Received unexpected event network-vif-plugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 for instance with vm_state building and task_state spawning.
Nov 16 15:20:52 user nova-compute[74658]: INFO nova.compute.manager [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 16 15:20:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:20:52 user nova-compute[74658]: INFO nova.compute.manager [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Took 6.85 seconds to build instance.
Nov 16 15:20:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0ba1313a-4653-4e5c-a251-3b490eb5fbfe tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.011s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-982e44a6-6531-4b48-b481-315a5fc895ba req-4caef920-0fc0-4ed0-9dcb-067bf3ed74cc service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-982e44a6-6531-4b48-b481-315a5fc895ba req-4caef920-0fc0-4ed0-9dcb-067bf3ed74cc service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-982e44a6-6531-4b48-b481-315a5fc895ba req-4caef920-0fc0-4ed0-9dcb-067bf3ed74cc service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-982e44a6-6531-4b48-b481-315a5fc895ba req-4caef920-0fc0-4ed0-9dcb-067bf3ed74cc service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-982e44a6-6531-4b48-b481-315a5fc895ba req-4caef920-0fc0-4ed0-9dcb-067bf3ed74cc service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:20:54 user nova-compute[74658]: WARNING nova.compute.manager [req-982e44a6-6531-4b48-b481-315a5fc895ba req-4caef920-0fc0-4ed0-9dcb-067bf3ed74cc service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received unexpected event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with vm_state building and task_state spawning.
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lazy-loading 'flavor' on Instance uuid 51f00d67-ae3d-4d1b-a721-280bae2e9caf {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:54 user nova-compute[74658]: INFO nova.compute.manager [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Attaching volume bb4b2049-384a-4e93-a6ce-2b020659e81d to /dev/vdb
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG os_brick.utils [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[21233f4c-7892-4228-abbc-4098f87f9145]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b022b40c-893c-4777-9206-18b5ce53c676]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96a25a5-ac16-40a0-a049-17b9352bda42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cf6c8e-1d13-421e-8179-a4b2bd6f5cd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:20:54 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4f400-fb42-4b1f-af57-023ffbf67156]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG os_brick.utils [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating existing volume attachment record: d723a5ed-a7c6-493c-b7b2-4090ebe10e13 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAdlHtrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:20:55 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:20:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:20:55 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:20:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:20:55 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1213add6-3b6b-460a-bbcb-4a0fbd4dc2e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:20:55 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3d9db6-ba64-410c-86f0-a99d894be61a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d] added
Nov 16 15:20:55 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecaa9d6-f4ca-483c-9944-fa8600d0ecdf]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aca9ad-19b8-45aa-8ba9-4d6e0ea42b25]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAdlHtrh {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:20:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAdlHtrh" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c358b497-d478-4405-b14c-bd9a22f42eb8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fAdlHtrh'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf55e21-c73c-4bf3-8b9d-5820da860d3c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-91db81fd-e8e7-4407-b3a7-aafd86268a93 req-33d72b08-0875-44c2-b187-61f1ccb86bce service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-91db81fd-e8e7-4407-b3a7-aafd86268a93 req-33d72b08-0875-44c2-b187-61f1ccb86bce service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-91db81fd-e8e7-4407-b3a7-aafd86268a93 req-33d72b08-0875-44c2-b187-61f1ccb86bce service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-91db81fd-e8e7-4407-b3a7-aafd86268a93 req-33d72b08-0875-44c2-b187-61f1ccb86bce service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-91db81fd-e8e7-4407-b3a7-aafd86268a93 req-33d72b08-0875-44c2-b187-61f1ccb86bce service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:20:56 user nova-compute[74658]: WARNING nova.compute.manager [req-91db81fd-e8e7-4407-b3a7-aafd86268a93 req-33d72b08-0875-44c2-b187-61f1ccb86bce service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received unexpected event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with vm_state building and task_state spawning.
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f78cc83-fa93-470e-97d5-7ae281dab347]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:56 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:56 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f4ea10-5f6d-412f-b3d6-1b616a93cf74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d, portal: 172.16.0.220,3260]
Nov 16 15:20:56 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d, portal: 172.16.0.220,3260] successful.
Nov 16 15:20:56 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea072c7-d1e5-4b72-992a-9ba6fd5e5c2c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[06246a81-8832-409a-89f6-a2062342851e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:56 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:20:56 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:20:56 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:20:56 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7b967a-9d4b-4585-aa2a-4634f7267650]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAdlHtrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.compute.manager [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:56 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Instance spawned successfully.
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:20:56 user nova-compute[74658]: INFO nova.compute.manager [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Took 7.83 seconds to spawn the instance on the hypervisor.
Nov 16 15:20:56 user nova-compute[74658]: DEBUG nova.compute.manager [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:56 user nova-compute[74658]: INFO nova.compute.manager [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Took 8.87 seconds to build instance.
Nov 16 15:20:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-96e956db-fc32-4840-bc96-6c9c5b2f581b tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.969s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '26434333366656333', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434333366656333', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'flavor' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:20:57 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:20:57 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:20:57 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:20:57 user nova-compute[74658]:   <serial>1e38a4c3-f416-4157-9c21-063e29002b7d</serial>
Nov 16 15:20:57 user nova-compute[74658]: </disk>
Nov 16 15:20:57 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:20:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:20:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:20:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8159MB free_disk=25.694129943847656GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] No VIF found with MAC fa:16:3e:54:3a:cb, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 03cbebbf-5414-4309-bfc1-ec0a67e09a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e06fcb99-9271-48da-ac95-3998d45e6ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 51f00d67-ae3d-4d1b-a721-280bae2e9caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance d497d108-2eb4-448d-9d1f-e8864e0b48a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 11bd9639-1c9e-4080-bd89-bf34724684d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 020c2d27-cb9b-4624-acea-e3e4446ccbfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:20:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d811227-0006-43d0-8938-1e1e535eb031 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.434s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:59 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:20:59 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:20:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:20:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:20:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:20:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:00 user nova-compute[74658]: INFO nova.compute.manager [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Rescuing
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquired lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updating instance_info_cache with network_info: [{"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Releasing lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZfabDrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:21:00 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:21:00 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:21:00 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c798c76c-4ff9-42b9-8bca-6268a0c921fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:21:00 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb229f7b-1786-4a69-80d0-dd53ddc0863c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d] added
Nov 16 15:21:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8811e6-bc79-486e-8efc-f8257222f591]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a45c660-7f55-42ce-9bd7-b6503cdc610b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZfabDrQ {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZfabDrQ" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c209b1-6c17-41df-90e5-f322f1af7099]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZfabDrQ'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.048s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e82704-1e38-4975-aa2a-e9840e1c881b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[db822bf5-5f04-4b94-8bfa-aa5e58ec29ff]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:21:00 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:21:00 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[91477268-4c29-4345-be0c-a80b0d4500b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]
Nov 16 15:21:00 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.
Nov 16 15:21:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[427ee8c0-5c3e-44f5-9a87-d5a485ab1511]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-b1c79592-9d89-4aa0-9aff-cf8499368560 req-cfe066d9-655f-42c3-a582-35b094eaf50f service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-unplugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b1c79592-9d89-4aa0-9aff-cf8499368560 req-cfe066d9-655f-42c3-a582-35b094eaf50f service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b1c79592-9d89-4aa0-9aff-cf8499368560 req-cfe066d9-655f-42c3-a582-35b094eaf50f service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b1c79592-9d89-4aa0-9aff-cf8499368560 req-cfe066d9-655f-42c3-a582-35b094eaf50f service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-b1c79592-9d89-4aa0-9aff-cf8499368560 req-cfe066d9-655f-42c3-a582-35b094eaf50f service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-unplugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:01 user nova-compute[74658]: WARNING nova.compute.manager [req-b1c79592-9d89-4aa0-9aff-cf8499368560 req-cfe066d9-655f-42c3-a582-35b094eaf50f service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received unexpected event network-vif-unplugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with vm_state active and task_state rescuing.
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1649e8-9d07-4fa6-a3d8-8b14a04d3cd6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:21:01 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:01 user nova-compute[74658]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:01 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:21:01 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:01 user nova-compute[74658]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:01 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fccce8-619f-4184-bccf-942764f698b7]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZfabDrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Instance destroyed successfully.
Nov 16 15:21:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Attempting a stable device rescue
Nov 16 15:21:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74658) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Instance directory exists: not creating {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 15:21:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Creating image(s)
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "/opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "/opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "/opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG nova.objects.instance [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'trusted_certs' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "6ca692ecb222ae5d5d80f8de4f275eab558b4e7a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "6ca692ecb222ae5d5d80f8de4f275eab558b4e7a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a.part --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.552s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] <== connect_volume: return (2555ms) {'type': 'block', 'scsi_wwn': '23131386261666362', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131386261666362', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-27102292-c080-41a7-be4d-316cc6e0e976 req-7d0dbc3f-f858-42b8-bec1-070d32b48cd8 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27102292-c080-41a7-be4d-316cc6e0e976 req-7d0dbc3f-f858-42b8-bec1-070d32b48cd8 service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27102292-c080-41a7-be4d-316cc6e0e976 req-7d0dbc3f-f858-42b8-bec1-070d32b48cd8 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-27102292-c080-41a7-be4d-316cc6e0e976 req-7d0dbc3f-f858-42b8-bec1-070d32b48cd8 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-27102292-c080-41a7-be4d-316cc6e0e976 req-7d0dbc3f-f858-42b8-bec1-070d32b48cd8 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:03 user nova-compute[74658]: WARNING nova.compute.manager [req-27102292-c080-41a7-be4d-316cc6e0e976 req-7d0dbc3f-f858-42b8-bec1-070d32b48cd8 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received unexpected event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with vm_state active and task_state rescuing.
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:03 user nova-compute[74658]: INFO nova.compute.manager [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Terminating instance
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lazy-loading 'flavor' on Instance uuid 51f00d67-ae3d-4d1b-a721-280bae2e9caf {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:21:03 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:21:03 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:21:03 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:21:03 user nova-compute[74658]:   <serial>bb4b2049-384a-4e93-a6ce-2b020659e81d</serial>
Nov 16 15:21:03 user nova-compute[74658]: </disk>
Nov 16 15:21:03 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating instance_info_cache with network_info: [{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a.part --force-share --output=json" returned: 0 in 0.250s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.virt.images [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] 557706b3-3e68-4b2d-b32d-bb2f05fcec1f was qcow2, converting to raw {{(pid=74658) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a.part /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a.converted {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-0025c1da-3522-4757-866b-7c4e2d97e1e4 req-b05d5a04-e2f9-4b01-93e2-4d22d64e6282 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Received event network-vif-unplugged-1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0025c1da-3522-4757-866b-7c4e2d97e1e4 req-b05d5a04-e2f9-4b01-93e2-4d22d64e6282 service nova] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0025c1da-3522-4757-866b-7c4e2d97e1e4 req-b05d5a04-e2f9-4b01-93e2-4d22d64e6282 service nova] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0025c1da-3522-4757-866b-7c4e2d97e1e4 req-b05d5a04-e2f9-4b01-93e2-4d22d64e6282 service nova] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-0025c1da-3522-4757-866b-7c4e2d97e1e4 req-b05d5a04-e2f9-4b01-93e2-4d22d64e6282 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] No waiting events found dispatching network-vif-unplugged-1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-0025c1da-3522-4757-866b-7c4e2d97e1e4 req-b05d5a04-e2f9-4b01-93e2-4d22d64e6282 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Received event network-vif-unplugged-1772b72e-f08e-4494-8023-b54d65490e21 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] No VIF found with MAC fa:16:3e:83:53:58, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a.part /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a.converted" returned: 0 in 0.671s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a.converted --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ab93d94e-bd7d-4d53-a563-9eacc882a0d2 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.741s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "6ca692ecb222ae5d5d80f8de4f275eab558b4e7a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.477s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "6ca692ecb222ae5d5d80f8de4f275eab558b4e7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "6ca692ecb222ae5d5d80f8de4f275eab558b4e7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Instance destroyed successfully.
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lazy-loading 'resources' on Instance uuid 11bd9639-1c9e-4080-bd89-bf34724684d5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2050760709',display_name='tempest-TestVolumeSwap-server-2050760709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2050760709',id=8,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpusj1BiFnUMN1OBt657lhe/ktnhwL+RHoDydZ7IALfTffJm//qB9BLq1nXrgji0G6SNJTVsCt6gxeQk28dmlylh/GpMiHp4Fpr0tYayGJHkUAWT8YVQ/NF8zJyONPClw==',key_name='tempest-keypair-1377503364',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f1b74d765ef4353b10308124094030f',ramdisk_id='',reservation_id='r-keemv6rb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-404220467',owner_user_name='tempest-TestVolumeSwap-404220467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029a0cbbc9444018c91ef577408605a',uuid=11bd9639-1c9e-4080-bd89-bf34724684d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1772b72e-f08e-4494-8023-b54d65490e21", "address": "fa:16:3e:c9:8d:a0", "network": {"id": "10b7ee2b-413e-4661-a24c-632afd5beae1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1561286324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f1b74d765ef4353b10308124094030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772b72e-f0", "ovs_interfaceid": "1772b72e-f08e-4494-8023-b54d65490e21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Converting VIF {"id": "1772b72e-f08e-4494-8023-b54d65490e21", "address": "fa:16:3e:c9:8d:a0", "network": {"id": "10b7ee2b-413e-4661-a24c-632afd5beae1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1561286324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f1b74d765ef4353b10308124094030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772b72e-f0", "ovs_interfaceid": "1772b72e-f08e-4494-8023-b54d65490e21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:8d:a0,bridge_name='br-int',has_traffic_filtering=True,id=1772b72e-f08e-4494-8023-b54d65490e21,network=Network(10b7ee2b-413e-4661-a24c-632afd5beae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772b72e-f0') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG os_vif [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:8d:a0,bridge_name='br-int',has_traffic_filtering=True,id=1772b72e-f08e-4494-8023-b54d65490e21,network=Network(10b7ee2b-413e-4661-a24c-632afd5beae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772b72e-f0') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1772b72e-f0, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f6773f4-3ff6-424f-8b76-c165047c1680) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:04 user nova-compute[74658]: INFO os_vif [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:8d:a0,bridge_name='br-int',has_traffic_filtering=True,id=1772b72e-f08e-4494-8023-b54d65490e21,network=Network(10b7ee2b-413e-4661-a24c-632afd5beae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772b72e-f0')
Nov 16 15:21:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Deleting instance files /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5_del
Nov 16 15:21:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Deletion of /opt/stack/data/nova/instances/11bd9639-1c9e-4080-bd89-bf34724684d5_del complete
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a --force-share --output=json" returned: 0 in 0.332s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a,backing_fmt=raw /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.rescue {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a,backing_fmt=raw /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.rescue" returned: 0 in 0.064s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "6ca692ecb222ae5d5d80f8de4f275eab558b4e7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.403s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'migration_context' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:21:04 user nova-compute[74658]: INFO nova.compute.manager [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Took 1.50 seconds to destroy the instance on the hypervisor.
Nov 16 15:21:04 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.objects.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Object Instance<e06fcb99-9271-48da-ac95-3998d45e6ccb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Start _get_guest_xml network_info=[{"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "vif_mac": "fa:16:3e:54:3a:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '557706b3-3e68-4b2d-b32d-bb2f05fcec1f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b785d22b-b72e-419f-a652-3868ab037433', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAdlHtrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e06fcb99-9271-48da-ac95-3998d45e6ccb', 'attached_at': '', 'detached_at': '', 'volume_id': '1e38a4c3-f416-4157-9c21-063e29002b7d', 'serial': '1e38a4c3-f416-4157-9c21-063e29002b7d'}, 'boot_index': None, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'resources' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.objects.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Object Instance<e06fcb99-9271-48da-ac95-3998d45e6ccb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:21:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'numa_topology' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.objects.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Object Instance<e06fcb99-9271-48da-ac95-3998d45e6ccb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:21:05 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:21:05 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.objects.instance [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'vcpu_model' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.objects.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Object Instance<e06fcb99-9271-48da-ac95-3998d45e6ccb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAdlHtrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:21:05 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:21:05 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:21:05 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bea271-aabf-4205-a6b3-9c5b49f9334a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fAdlHtrh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 15:21:05 user nova-compute[74658]: node.name = iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:21:05 user nova-compute[74658]: node.tpgt = -1
Nov 16 15:21:05 user nova-compute[74658]: node.startup = automatic
Nov 16 15:21:05 user nova-compute[74658]: node.leading_login = No
Nov 16 15:21:05 user nova-compute[74658]: iface.iscsi_ifacename = default
Nov 16 15:21:05 user nova-compute[74658]: iface.net_ifacename = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.ipaddress = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.prefix_len = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.hwaddress = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.transport_name = tcp
Nov 16 15:21:05 user nova-compute[74658]: iface.initiatorname = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.state = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.vlan_id = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.vlan_priority = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.vlan_state = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.iface_num = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.mtu = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.port = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.bootproto = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.subnet_mask = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.gateway = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.dhcp_alt_client_id = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.dhcp_dns = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.dhcp_learn_iqn = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.dhcp_vendor_id_state = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.dhcp_vendor_id = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.dhcp_slp_da = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.fragmentation = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.gratuitous_arp = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.incoming_forwarding = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.tos_state = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.tos = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.ttl = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.delayed_ack = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.tcp_nagle = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.tcp_wsf_state = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.tcp_wsf = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.tcp_timer_scale = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.tcp_timestamp = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.redirect = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.def_task_mgmt_timeout = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.header_digest = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.data_digest = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.immediate_data = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.initial_r2t = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.data_seq_inorder = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.data_pdu_inorder = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.erl = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.max_receive_data_len = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.first_burst_len = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.max_outstanding_r2t = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.max_burst_len = 0
Nov 16 15:21:05 user nova-compute[74658]: iface.chap_auth = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.bidi_chap = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.strict_login_compliance = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.discovery_auth = <empty>
Nov 16 15:21:05 user nova-compute[74658]: iface.discovery_logout = <empty>
Nov 16 15:21:05 user nova-compute[74658]: node.discovery_address = <empty>
Nov 16 15:21:05 user nova-compute[74658]: node.discovery_port = 0
Nov 16 15:21:05 user nova-compute[74658]: node.discovery_type = static
Nov 16 15:21:05 user nova-compute[74658]: node.session.initial_cmdsn = 0
Nov 16 15:21:05 user nova-compute[74658]: node.session.initial_login_retry_max = 8
Nov 16 15:21:05 user nova-compute[74658]: node.session.xmit_thread_priority = -20
Nov 16 15:21:05 user nova-compute[74658]: node.session.cmds_max = 128
Nov 16 15:21:05 user nova-compute[74658]: node.session.queue_depth = 32
Nov 16 15:21:05 user nova-compute[74658]: node.session.nr_sessions = 1
Nov 16 15:21:05 user nova-compute[74658]: node.session.auth.authmethod = CHAP
Nov 16 15:21:05 user nova-compute[74658]: node.session.auth.username = fAdlHtrh
Nov 16 15:21:05 user nova-compute[74658]: node.session.auth.password = ***
Nov 16 15:21:05 user nova-compute[74658]: node.session.auth.username_in = <empty>
Nov 16 15:21:05 user nova-compute[74658]: node.session.auth.password_in = <empty>
Nov 16 15:21:05 user nova-compute[74658]: node.session.auth.chap_algs = MD5
Nov 16 15:21:05 user nova-compute[74658]: node.session.timeo.replacement_timeout = 120
Nov 16 15:21:05 user nova-compute[74658]: node.session.err_timeo.abort_timeout = 15
Nov 16 15:21:05 user nova-compute[74658]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 15:21:05 user nova-compute[74658]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 15:21:05 user nova-compute[74658]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 15:21:05 user nova-compute[74658]: node.session.iscsi.FastAbort = Yes
Nov 16 15:21:05 user nova-compute[74658]: node.session.iscsi.InitialR2T = No
Nov 16 15:21:05 user nova-compute[74658]: node.session.iscsi.ImmediateData = Yes
Nov 16 15:21:05 user nova-compute[74658]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 15:21:05 user nova-compute[74658]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 15:21:05 user nova-compute[74658]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 15:21:05 user nova-compute[74658]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 15:21:05 user nova-compute[74658]: node.session.iscsi.MaxConnections = 1
Nov 16 15:21:05 user nova-compute[74658]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 15:21:05 user nova-compute[74658]: node.session.iscsi.ERL = 0
Nov 16 15:21:05 user nova-compute[74658]: node.session.scan = manual
Nov 16 15:21:05 user nova-compute[74658]: node.session.reopen_max = 0
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].address = 172.16.0.220
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].port = 3260
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].startup = manual
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].tcp.window_size = 524288
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].tcp.type_of_service = 0
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].timeo.logout_timeout = 15
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].timeo.login_timeout = 15
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].timeo.auth_timeout = 45
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].iscsi.DataDigest = None
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].iscsi.IFMarker = No
Nov 16 15:21:05 user nova-compute[74658]: node.conn[0].iscsi.OFMarker = No
Nov 16 15:21:05 user nova-compute[74658]: # END RECORD
Nov 16 15:21:05 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f5ef1d-e7b0-473d-a662-f73e24c26ba1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8af42d7-4cea-47f6-86ef-8baa3a284403]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAdlHtrh {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAdlHtrh" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b28a0-5657-4964-9270-a3f00a29bda5]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fAdlHtrh'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274eb5e-9e44-4fa4-9ddd-5fb1dae99ab9]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[58123d80-d33c-4d0d-be10-55b274ab4594]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:21:05 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:05 user nova-compute[74658]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:05 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:21:05 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:05 user nova-compute[74658]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:05 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] HCTL ('33', '0', '0', 0) found on session 15 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe8e39f-c8a6-4773-a78e-6c535509a22e]: (4, ('0 0 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Searching for a device in session 15 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAdlHtrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '26434333366656333', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434333366656333', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-228686850',display_name='tempest-ServerStableDeviceRescueTest-server-228686850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-228686850',id=4,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVunN5SWyPcwINY6srB+ewdi3nrsftWq/NkFlvGrCChZ5MlRH6RAFPYwHcXxkfPihChhmEuLuesilMmMMfBAuKVH8FxMhGNYqhemohPM52Id5BtJVMJgwtLbhP/0YxsjA==',key_name='tempest-keypair-1727289241',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d59693f6c93045eb86ae04a661060b9c',ramdisk_id='',reservation_id='r-t43gbh1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-509064368',owner_user_name='tempest-ServerStableDeviceRescueTest-509064368-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ee1cb04054422e9e93a271b5b3d68f',uuid=e06fcb99-9271-48da-ac95-3998d45e6ccb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "vif_mac": "fa:16:3e:54:3a:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Converting VIF {"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "vif_mac": "fa:16:3e:54:3a:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:3a:cb,bridge_name='br-int',has_traffic_filtering=True,id=a370fa54-9887-42af-b8e5-ab80c536cccd,network=Network(a84e7dcd-9cee-4b29-85eb-6eb7441efd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa370fa54-98') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.objects.instance [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'pci_devices' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.objects.base [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Object Instance<e06fcb99-9271-48da-ac95-3998d45e6ccb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:21:05 user nova-compute[74658]:   <uuid>e06fcb99-9271-48da-ac95-3998d45e6ccb</uuid>
Nov 16 15:21:05 user nova-compute[74658]:   <name>instance-00000004</name>
Nov 16 15:21:05 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:21:05 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:21:05 user nova-compute[74658]:   <metadata>
Nov 16 15:21:05 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:21:05 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:21:05 user nova-compute[74658]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-228686850</nova:name>
Nov 16 15:21:05 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:21:05</nova:creationTime>
Nov 16 15:21:05 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:21:05 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:21:05 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:21:05 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:21:05 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:21:05 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:21:05 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:21:05 user nova-compute[74658]:       <nova:owner>
Nov 16 15:21:05 user nova-compute[74658]:         <nova:user uuid="01ee1cb04054422e9e93a271b5b3d68f">tempest-ServerStableDeviceRescueTest-509064368-project-member</nova:user>
Nov 16 15:21:05 user nova-compute[74658]:         <nova:project uuid="d59693f6c93045eb86ae04a661060b9c">tempest-ServerStableDeviceRescueTest-509064368</nova:project>
Nov 16 15:21:05 user nova-compute[74658]:       </nova:owner>
Nov 16 15:21:05 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:21:05 user nova-compute[74658]:       <nova:ports>
Nov 16 15:21:05 user nova-compute[74658]:         <nova:port uuid="a370fa54-9887-42af-b8e5-ab80c536cccd">
Nov 16 15:21:05 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 15:21:05 user nova-compute[74658]:         </nova:port>
Nov 16 15:21:05 user nova-compute[74658]:       </nova:ports>
Nov 16 15:21:05 user nova-compute[74658]:     </nova:instance>
Nov 16 15:21:05 user nova-compute[74658]:   </metadata>
Nov 16 15:21:05 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:21:05 user nova-compute[74658]:     <system>
Nov 16 15:21:05 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:21:05 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:21:05 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:21:05 user nova-compute[74658]:       <entry name="serial">e06fcb99-9271-48da-ac95-3998d45e6ccb</entry>
Nov 16 15:21:05 user nova-compute[74658]:       <entry name="uuid">e06fcb99-9271-48da-ac95-3998d45e6ccb</entry>
Nov 16 15:21:05 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:21:05 user nova-compute[74658]:     </system>
Nov 16 15:21:05 user nova-compute[74658]:   </sysinfo>
Nov 16 15:21:05 user nova-compute[74658]:   <os>
Nov 16 15:21:05 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:21:05 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:21:05 user nova-compute[74658]:   </os>
Nov 16 15:21:05 user nova-compute[74658]:   <features>
Nov 16 15:21:05 user nova-compute[74658]:     <acpi/>
Nov 16 15:21:05 user nova-compute[74658]:     <apic/>
Nov 16 15:21:05 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:21:05 user nova-compute[74658]:   </features>
Nov 16 15:21:05 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:21:05 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:21:05 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:21:05 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:21:05 user nova-compute[74658]:   </clock>
Nov 16 15:21:05 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:21:05 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:21:05 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:21:05 user nova-compute[74658]:   </cpu>
Nov 16 15:21:05 user nova-compute[74658]:   <devices>
Nov 16 15:21:05 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:21:05 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:21:05 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk"/>
Nov 16 15:21:05 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:21:05 user nova-compute[74658]:     </disk>
Nov 16 15:21:05 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:21:05 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:21:05 user nova-compute[74658]:       <source dev="/dev/sdb"/>
Nov 16 15:21:05 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:21:05 user nova-compute[74658]:       <serial>1e38a4c3-f416-4157-9c21-063e29002b7d</serial>
Nov 16 15:21:05 user nova-compute[74658]:     </disk>
Nov 16 15:21:05 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:21:05 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:21:05 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.rescue"/>
Nov 16 15:21:05 user nova-compute[74658]:       <target dev="vdc" bus="virtio"/>
Nov 16 15:21:05 user nova-compute[74658]:       <boot order="1"/>
Nov 16 15:21:05 user nova-compute[74658]:     </disk>
Nov 16 15:21:05 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:21:05 user nova-compute[74658]:       <mac address="fa:16:3e:54:3a:cb"/>
Nov 16 15:21:05 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:21:05 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:21:05 user nova-compute[74658]:       <target dev="tapa370fa54-98"/>
Nov 16 15:21:05 user nova-compute[74658]:     </interface>
Nov 16 15:21:05 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:21:05 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/console.log" append="off"/>
Nov 16 15:21:05 user nova-compute[74658]:     </serial>
Nov 16 15:21:05 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:21:05 user nova-compute[74658]:     <video>
Nov 16 15:21:05 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:21:05 user nova-compute[74658]:     </video>
Nov 16 15:21:05 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:21:05 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:21:05 user nova-compute[74658]:     </rng>
Nov 16 15:21:05 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:21:05 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:21:05 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:21:05 user nova-compute[74658]:     </memballoon>
Nov 16 15:21:05 user nova-compute[74658]:   </devices>
Nov 16 15:21:05 user nova-compute[74658]: </domain>
Nov 16 15:21:05 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:21:05 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Instance destroyed successfully.
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-fb15d593-250b-48bb-bb11-4aed983fbc2c req-2fba828d-64c5-462e-930a-c9b7f2e87519 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Received event network-vif-plugged-1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fb15d593-250b-48bb-bb11-4aed983fbc2c req-2fba828d-64c5-462e-930a-c9b7f2e87519 service nova] Acquiring lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fb15d593-250b-48bb-bb11-4aed983fbc2c req-2fba828d-64c5-462e-930a-c9b7f2e87519 service nova] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fb15d593-250b-48bb-bb11-4aed983fbc2c req-2fba828d-64c5-462e-930a-c9b7f2e87519 service nova] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-fb15d593-250b-48bb-bb11-4aed983fbc2c req-2fba828d-64c5-462e-930a-c9b7f2e87519 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] No waiting events found dispatching network-vif-plugged-1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:05 user nova-compute[74658]: WARNING nova.compute.manager [req-fb15d593-250b-48bb-bb11-4aed983fbc2c req-2fba828d-64c5-462e-930a-c9b7f2e87519 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Received unexpected event network-vif-plugged-1772b72e-f08e-4494-8023-b54d65490e21 for instance with vm_state active and task_state deleting.
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:21:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] No VIF found with MAC fa:16:3e:54:3a:cb, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:21:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:06 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-6c2bf33a-40df-4f0f-b539-4195e78e3818 req-f5617959-2c31-4c71-9d9c-83dcae774bf5 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Received event network-vif-deleted-1772b72e-f08e-4494-8023-b54d65490e21 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:06 user nova-compute[74658]: INFO nova.compute.manager [req-6c2bf33a-40df-4f0f-b539-4195e78e3818 req-f5617959-2c31-4c71-9d9c-83dcae774bf5 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Neutron deleted interface 1772b72e-f08e-4494-8023-b54d65490e21; detaching it from the instance and deleting it from the info cache
Nov 16 15:21:06 user nova-compute[74658]: DEBUG nova.network.neutron [req-6c2bf33a-40df-4f0f-b539-4195e78e3818 req-f5617959-2c31-4c71-9d9c-83dcae774bf5 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:06 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Took 2.18 seconds to deallocate network for instance.
Nov 16 15:21:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-6c2bf33a-40df-4f0f-b539-4195e78e3818 req-f5617959-2c31-4c71-9d9c-83dcae774bf5 service nova] [instance: 11bd9639-1c9e-4080-bd89-bf34724684d5] Detach interface failed, port_id=1772b72e-f08e-4494-8023-b54d65490e21, reason: Instance 11bd9639-1c9e-4080-bd89-bf34724684d5 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:21:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Stashing vm_state: active {{(pid=74658) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 15:21:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:07 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:21:07 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:21:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.341s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:07 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Deleted allocations for instance 11bd9639-1c9e-4080-bd89-bf34724684d5
Nov 16 15:21:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:21:07 user nova-compute[74658]: INFO nova.compute.claims [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Claim successful on node user
Nov 16 15:21:07 user nova-compute[74658]: INFO nova.compute.resource_tracker [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating resource usage from migration f3c2298c-e980-4f50-b9f1-5bd6118c24c8
Nov 16 15:21:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7adcb19-3efe-4aa4-a355-52bff9e850ae tempest-TestVolumeSwap-404220467 tempest-TestVolumeSwap-404220467-project-member] Lock "11bd9639-1c9e-4080-bd89-bf34724684d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.623s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.554s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:08 user nova-compute[74658]: INFO nova.compute.manager [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Migrating
Nov 16 15:21:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:08 user nova-compute[74658]: INFO nova.compute.rpcapi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 16 15:21:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquired lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG nova.network.neutron [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating instance_info_cache with network_info: [{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Releasing lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Starting migrate_disk_and_power_off {{(pid=74658) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:21:09 user nova-compute[74658]: INFO nova.compute.claims [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Claim successful on node user
Nov 16 15:21:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-d7e9c306-c52f-47cd-b70a-07189f0f0186 req-d55eed7a-6318-4223-acd8-c5669fc56af7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-unplugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d7e9c306-c52f-47cd-b70a-07189f0f0186 req-d55eed7a-6318-4223-acd8-c5669fc56af7 service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d7e9c306-c52f-47cd-b70a-07189f0f0186 req-d55eed7a-6318-4223-acd8-c5669fc56af7 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d7e9c306-c52f-47cd-b70a-07189f0f0186 req-d55eed7a-6318-4223-acd8-c5669fc56af7 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-d7e9c306-c52f-47cd-b70a-07189f0f0186 req-d55eed7a-6318-4223-acd8-c5669fc56af7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-unplugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:09 user nova-compute[74658]: WARNING nova.compute.manager [req-d7e9c306-c52f-47cd-b70a-07189f0f0186 req-d55eed7a-6318-4223-acd8-c5669fc56af7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received unexpected event network-vif-unplugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with vm_state active and task_state resize_migrating.
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-5ae6c2e4-64c6-45e1-9f45-c49303d54504 req-ed44eca0-ea5a-44b0-b524-070aba15bdc1 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5ae6c2e4-64c6-45e1-9f45-c49303d54504 req-ed44eca0-ea5a-44b0-b524-070aba15bdc1 service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5ae6c2e4-64c6-45e1-9f45-c49303d54504 req-ed44eca0-ea5a-44b0-b524-070aba15bdc1 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5ae6c2e4-64c6-45e1-9f45-c49303d54504 req-ed44eca0-ea5a-44b0-b524-070aba15bdc1 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-5ae6c2e4-64c6-45e1-9f45-c49303d54504 req-ed44eca0-ea5a-44b0-b524-070aba15bdc1 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:09 user nova-compute[74658]: WARNING nova.compute.manager [req-5ae6c2e4-64c6-45e1-9f45-c49303d54504 req-ed44eca0-ea5a-44b0-b524-070aba15bdc1 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received unexpected event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with vm_state active and task_state rescuing.
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:21:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:21:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:21:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:21:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance destroyed successfully.
Nov 16 15:21:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1901009930',display_name='tempest-ServerActionsTestOtherB-server-1901009930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1901009930',id=5,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfYsAQlC3nkxAyuTL+KN50dEAunY5gw1KQEIPq+iR4mJ4asJBSmjta4eGNIIDBn+5Mv+AkdxZhEfTWggAEXb2LpORaOL7hjybIPHi4K1ldg1rK7G6KYvZmZ7N35zLKD+g==',key_name='tempest-keypair-983162783',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1e465eeac8f4bc5b11c0a6e3a7bbc61',ramdisk_id='',reservation_id='r-gupt4lp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-662756880',owner_user_name='tempest-ServerActionsTestOtherB-662756880-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aa837a8e0f14644a3b6b0d3904213f2',uuid=51f00d67-ae3d-4d1b-a721-280bae2e9caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1435805198-network", "vif_mac": "fa:16:3e:83:53:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converting VIF {"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1435805198-network", "vif_mac": "fa:16:3e:83:53:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_vif [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6abed81e-25, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-bed07a75-b394-4430-8bec-a842bab2545c tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6405827c-fd64-444b-97a1-93410df28028) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:21:10 user nova-compute[74658]: INFO os_vif [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25')
Nov 16 15:21:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZfabDrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:21:10 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6e20dc-03be-4682-9a64-d32598fb2503]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:21:10 user nova-compute[74658]: No targets found.
Nov 16 15:21:10 user nova-compute[74658]: iSNS:
Nov 16 15:21:10 user nova-compute[74658]: No targets found.
Nov 16 15:21:10 user nova-compute[74658]: STATIC:
Nov 16 15:21:10 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:21:10 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:21:10 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:21:10 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:21:10 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:21:10 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:21:10 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:21:10 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:21:10 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:21:10 user nova-compute[74658]: FIRMWARE:
Nov 16 15:21:10 user nova-compute[74658]: No targets found.
Nov 16 15:21:10 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:21:10 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:21:10 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09045d7-38ef-493a-b898-c6730df04d97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:21:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Creating image(s)
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "/opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "/opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f3a564-495d-4e48-a5f4-f71c5610955f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:21:10 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:10 user nova-compute[74658]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:10 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:21:10 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:10 user nova-compute[74658]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:10 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07100fe170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb768cf7-4e8e-45dc-bff3-55937c585559]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[741e88d2-da44-452d-9e6d-35449a96288a]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b3f07f-c12f-4de3-9a3f-ecceaa44bcaa]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG nova.policy [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3ae2183da41421f88946b3cea996833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19164c5a777949f790615128d2ee350c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.091s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18081b2-badd-4c2a-9278-e4ada9471f92]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.406s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.108s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e247e4-5319-4c64-90d3-256011ead457]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe912b8f-7e43-4cc6-946f-b53c07941043]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]
Nov 16 15:21:10 user nova-compute[74658]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.
Nov 16 15:21:10 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fd1da3-9100-459a-ad68-ce1ea934f3e1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.652s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] <== disconnect_volume: return (654ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.200s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk 1073741824" returned: 0 in 0.080s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.217s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf_resize/disk /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Cannot resize image /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Ensure instance console log exists: /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "cp -r /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf_resize/disk /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk" returned: 0 in 0.317s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf_resize/disk.info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk.info {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "cp -r /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf_resize/disk.info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk.info" returned: 0 in 0.033s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Successfully created port: 67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-db266bb3-0f8e-4ff4-80b8-fb241ffb9e58 req-67248d82-bd94-4983-85a0-b3e6ba394bdf service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db266bb3-0f8e-4ff4-80b8-fb241ffb9e58 req-67248d82-bd94-4983-85a0-b3e6ba394bdf service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db266bb3-0f8e-4ff4-80b8-fb241ffb9e58 req-67248d82-bd94-4983-85a0-b3e6ba394bdf service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db266bb3-0f8e-4ff4-80b8-fb241ffb9e58 req-67248d82-bd94-4983-85a0-b3e6ba394bdf service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-db266bb3-0f8e-4ff4-80b8-fb241ffb9e58 req-67248d82-bd94-4983-85a0-b3e6ba394bdf service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:11 user nova-compute[74658]: WARNING nova.compute.manager [req-db266bb3-0f8e-4ff4-80b8-fb241ffb9e58 req-67248d82-bd94-4983-85a0-b3e6ba394bdf service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received unexpected event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with vm_state active and task_state resize_migrating.
Nov 16 15:21:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-8ec4fc8b-b2a3-422f-b55a-399349f728d6 req-56a0e4c5-6d7b-4bfe-aac9-980f0689215c service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8ec4fc8b-b2a3-422f-b55a-399349f728d6 req-56a0e4c5-6d7b-4bfe-aac9-980f0689215c service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8ec4fc8b-b2a3-422f-b55a-399349f728d6 req-56a0e4c5-6d7b-4bfe-aac9-980f0689215c service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8ec4fc8b-b2a3-422f-b55a-399349f728d6 req-56a0e4c5-6d7b-4bfe-aac9-980f0689215c service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-8ec4fc8b-b2a3-422f-b55a-399349f728d6 req-56a0e4c5-6d7b-4bfe-aac9-980f0689215c service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:11 user nova-compute[74658]: WARNING nova.compute.manager [req-8ec4fc8b-b2a3-422f-b55a-399349f728d6 req-56a0e4c5-6d7b-4bfe-aac9-980f0689215c service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received unexpected event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with vm_state rescued and task_state None.
Nov 16 15:21:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Port 6abed81e-257d-4d47-a1b8-586c040fdc92 binding to destination host user is already ACTIVE {{(pid=74658) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 15:21:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Successfully updated port: 67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "refresh_cache-ca6f21ea-8469-4805-9efe-5580a8dcea56" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquired lock "refresh_cache-ca6f21ea-8469-4805-9efe-5580a8dcea56" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquired lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Updating instance_info_cache with network_info: [{"id": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "address": "fa:16:3e:8d:00:13", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ce586f-db", "ovs_interfaceid": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Releasing lock "refresh_cache-ca6f21ea-8469-4805-9efe-5580a8dcea56" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Instance network_info: |[{"id": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "address": "fa:16:3e:8d:00:13", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ce586f-db", "ovs_interfaceid": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Start _get_guest_xml network_info=[{"id": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "address": "fa:16:3e:8d:00:13", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ce586f-db", "ovs_interfaceid": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:21:13 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:21:13 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1142195448',display_name='tempest-VolumesSnapshotTestJSON-instance-1142195448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1142195448',id=15,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIjFcHU5I5YVVGvoH/06ibISQeAJxfWX5jCIqFc/hIKeHR5C549cpTLr/ovF1yVfu6IpT9N+oCeLN5bAZrsRLduZ94cwSx2II+frfeOnNH060F8G+XNpMjM8l1IE6476w==',key_name='tempest-keypair-791353115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19164c5a777949f790615128d2ee350c',ramdisk_id='',reservation_id='r-7toegaz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1886586727',owner_user_name='tempest-VolumesSnapshotTestJSON-1886586727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3ae2183da41421f88946b3cea996833',uuid=ca6f21ea-8469-4805-9efe-5580a8dcea56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "address": "fa:16:3e:8d:00:13", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ce586f-db", "ovs_interfaceid": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converting VIF {"id": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "address": "fa:16:3e:8d:00:13", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ce586f-db", "ovs_interfaceid": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:00:13,bridge_name='br-int',has_traffic_filtering=True,id=67ce586f-dbb2-46b3-84cc-5d3ffdcc8680,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ce586f-db') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lazy-loading 'pci_devices' on Instance uuid ca6f21ea-8469-4805-9efe-5580a8dcea56 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:21:13 user nova-compute[74658]:   <uuid>ca6f21ea-8469-4805-9efe-5580a8dcea56</uuid>
Nov 16 15:21:13 user nova-compute[74658]:   <name>instance-0000000f</name>
Nov 16 15:21:13 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:21:13 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:21:13 user nova-compute[74658]:   <metadata>
Nov 16 15:21:13 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:21:13 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:21:13 user nova-compute[74658]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1142195448</nova:name>
Nov 16 15:21:13 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:21:13</nova:creationTime>
Nov 16 15:21:13 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:21:13 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:21:13 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:21:13 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:21:13 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:21:13 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:21:13 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:21:13 user nova-compute[74658]:       <nova:owner>
Nov 16 15:21:13 user nova-compute[74658]:         <nova:user uuid="e3ae2183da41421f88946b3cea996833">tempest-VolumesSnapshotTestJSON-1886586727-project-member</nova:user>
Nov 16 15:21:13 user nova-compute[74658]:         <nova:project uuid="19164c5a777949f790615128d2ee350c">tempest-VolumesSnapshotTestJSON-1886586727</nova:project>
Nov 16 15:21:13 user nova-compute[74658]:       </nova:owner>
Nov 16 15:21:13 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:21:13 user nova-compute[74658]:       <nova:ports>
Nov 16 15:21:13 user nova-compute[74658]:         <nova:port uuid="67ce586f-dbb2-46b3-84cc-5d3ffdcc8680">
Nov 16 15:21:13 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 15:21:13 user nova-compute[74658]:         </nova:port>
Nov 16 15:21:13 user nova-compute[74658]:       </nova:ports>
Nov 16 15:21:13 user nova-compute[74658]:     </nova:instance>
Nov 16 15:21:13 user nova-compute[74658]:   </metadata>
Nov 16 15:21:13 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:21:13 user nova-compute[74658]:     <system>
Nov 16 15:21:13 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:21:13 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:21:13 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:21:13 user nova-compute[74658]:       <entry name="serial">ca6f21ea-8469-4805-9efe-5580a8dcea56</entry>
Nov 16 15:21:13 user nova-compute[74658]:       <entry name="uuid">ca6f21ea-8469-4805-9efe-5580a8dcea56</entry>
Nov 16 15:21:13 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:21:13 user nova-compute[74658]:     </system>
Nov 16 15:21:13 user nova-compute[74658]:   </sysinfo>
Nov 16 15:21:13 user nova-compute[74658]:   <os>
Nov 16 15:21:13 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:21:13 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:21:13 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:21:13 user nova-compute[74658]:   </os>
Nov 16 15:21:13 user nova-compute[74658]:   <features>
Nov 16 15:21:13 user nova-compute[74658]:     <acpi/>
Nov 16 15:21:13 user nova-compute[74658]:     <apic/>
Nov 16 15:21:13 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:21:13 user nova-compute[74658]:   </features>
Nov 16 15:21:13 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:21:13 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:21:13 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:21:13 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:21:13 user nova-compute[74658]:   </clock>
Nov 16 15:21:13 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:21:13 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:21:13 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:21:13 user nova-compute[74658]:   </cpu>
Nov 16 15:21:13 user nova-compute[74658]:   <devices>
Nov 16 15:21:13 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:21:13 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:21:13 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk"/>
Nov 16 15:21:13 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:21:13 user nova-compute[74658]:     </disk>
Nov 16 15:21:13 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:21:13 user nova-compute[74658]:       <mac address="fa:16:3e:8d:00:13"/>
Nov 16 15:21:13 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:21:13 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:21:13 user nova-compute[74658]:       <target dev="tap67ce586f-db"/>
Nov 16 15:21:13 user nova-compute[74658]:     </interface>
Nov 16 15:21:13 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:21:13 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/console.log" append="off"/>
Nov 16 15:21:13 user nova-compute[74658]:     </serial>
Nov 16 15:21:13 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:21:13 user nova-compute[74658]:     <video>
Nov 16 15:21:13 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:21:13 user nova-compute[74658]:     </video>
Nov 16 15:21:13 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:21:13 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:21:13 user nova-compute[74658]:     </rng>
Nov 16 15:21:13 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:21:13 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:21:13 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:21:13 user nova-compute[74658]:     </memballoon>
Nov 16 15:21:13 user nova-compute[74658]:   </devices>
Nov 16 15:21:13 user nova-compute[74658]: </domain>
Nov 16 15:21:13 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1142195448',display_name='tempest-VolumesSnapshotTestJSON-instance-1142195448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1142195448',id=15,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIjFcHU5I5YVVGvoH/06ibISQeAJxfWX5jCIqFc/hIKeHR5C549cpTLr/ovF1yVfu6IpT9N+oCeLN5bAZrsRLduZ94cwSx2II+frfeOnNH060F8G+XNpMjM8l1IE6476w==',key_name='tempest-keypair-791353115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19164c5a777949f790615128d2ee350c',ramdisk_id='',reservation_id='r-7toegaz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1886586727',owner_user_name='tempest-VolumesSnapshotTestJSON-1886586727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3ae2183da41421f88946b3cea996833',uuid=ca6f21ea-8469-4805-9efe-5580a8dcea56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "address": "fa:16:3e:8d:00:13", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ce586f-db", "ovs_interfaceid": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converting VIF {"id": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "address": "fa:16:3e:8d:00:13", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ce586f-db", "ovs_interfaceid": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:00:13,bridge_name='br-int',has_traffic_filtering=True,id=67ce586f-dbb2-46b3-84cc-5d3ffdcc8680,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ce586f-db') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG os_vif [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:00:13,bridge_name='br-int',has_traffic_filtering=True,id=67ce586f-dbb2-46b3-84cc-5d3ffdcc8680,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ce586f-db') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '711f0e52-d1cf-5a15-a1e8-f39bf1d9ba55', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67ce586f-db, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67ce586f-db, col_values=(('qos', UUID('5852a519-0776-42f2-b04c-449ee2195c64')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67ce586f-db, col_values=(('external_ids', {'iface-id': '67ce586f-dbb2-46b3-84cc-5d3ffdcc8680', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:00:13', 'vm-uuid': 'ca6f21ea-8469-4805-9efe-5580a8dcea56'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:13 user nova-compute[74658]: INFO os_vif [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:00:13,bridge_name='br-int',has_traffic_filtering=True,id=67ce586f-dbb2-46b3-84cc-5d3ffdcc8680,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ce586f-db')
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating instance_info_cache with network_info: [{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Releasing lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] No VIF found with MAC fa:16:3e:8d:00:13, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-236d1577-70eb-4ef1-9ab8-282f38cf3dcf req-83445694-353d-4559-88f9-958d98ebe3fe service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Received event network-changed-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-236d1577-70eb-4ef1-9ab8-282f38cf3dcf req-83445694-353d-4559-88f9-958d98ebe3fe service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Refreshing instance network info cache due to event network-changed-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-236d1577-70eb-4ef1-9ab8-282f38cf3dcf req-83445694-353d-4559-88f9-958d98ebe3fe service nova] Acquiring lock "refresh_cache-ca6f21ea-8469-4805-9efe-5580a8dcea56" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-236d1577-70eb-4ef1-9ab8-282f38cf3dcf req-83445694-353d-4559-88f9-958d98ebe3fe service nova] Acquired lock "refresh_cache-ca6f21ea-8469-4805-9efe-5580a8dcea56" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-236d1577-70eb-4ef1-9ab8-282f38cf3dcf req-83445694-353d-4559-88f9-958d98ebe3fe service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Refreshing network info cache for port 67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG os_brick.utils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4969e14-fa94-464b-a697-da964cc16030]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3214919a-7d59-48a4-9b41-2c32cf1623b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[be390310-f4eb-496a-aafa-dfab5c23ee43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f1615d-3e7a-490a-8340-fd2775c5a145]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:21:14 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:21:14 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[40969486-65ce-471d-a2a0-d75304772ae5]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG os_brick.utils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-236d1577-70eb-4ef1-9ab8-282f38cf3dcf req-83445694-353d-4559-88f9-958d98ebe3fe service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Updated VIF entry in instance network info cache for port 67ce586f-dbb2-46b3-84cc-5d3ffdcc8680. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-236d1577-70eb-4ef1-9ab8-282f38cf3dcf req-83445694-353d-4559-88f9-958d98ebe3fe service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Updating instance_info_cache with network_info: [{"id": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "address": "fa:16:3e:8d:00:13", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ce586f-db", "ovs_interfaceid": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-236d1577-70eb-4ef1-9ab8-282f38cf3dcf req-83445694-353d-4559-88f9-958d98ebe3fe service nova] Releasing lock "refresh_cache-ca6f21ea-8469-4805-9efe-5580a8dcea56" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:15 user nova-compute[74658]: DEBUG nova.compute.manager [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:21:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:15 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:21:15 user nova-compute[74658]: INFO nova.compute.claims [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Claim successful on node user
Nov 16 15:21:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:16 user nova-compute[74658]: INFO nova.compute.manager [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Terminating instance
Nov 16 15:21:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG nova.network.neutron [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:16 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:21:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG nova.policy [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ed5db501b2e4dcfb742e18dfdeae88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621284eebf704320bacac96aedbc77a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:21:16 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Creating image(s)
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "/opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "/opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "/opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-d0476cc7-ed20-43ab-97dd-b68236e4bb1f req-08ad78b8-34ea-4664-8667-277ad915333f service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-vif-unplugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d0476cc7-ed20-43ab-97dd-b68236e4bb1f req-08ad78b8-34ea-4664-8667-277ad915333f service nova] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d0476cc7-ed20-43ab-97dd-b68236e4bb1f req-08ad78b8-34ea-4664-8667-277ad915333f service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d0476cc7-ed20-43ab-97dd-b68236e4bb1f req-08ad78b8-34ea-4664-8667-277ad915333f service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-d0476cc7-ed20-43ab-97dd-b68236e4bb1f req-08ad78b8-34ea-4664-8667-277ad915333f service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] No waiting events found dispatching network-vif-unplugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-d0476cc7-ed20-43ab-97dd-b68236e4bb1f req-08ad78b8-34ea-4664-8667-277ad915333f service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-vif-unplugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Instance destroyed successfully.
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.objects.instance [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lazy-loading 'resources' on Instance uuid d497d108-2eb4-448d-9d1f-e8864e0b48a4 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1774448289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-950433439',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkap0gRNcurWDfCcy7qt804/okYphbvtBgQJOzKxESAFGAYHBwlIXmSq28wC/by2fh2JpmwGxBO4odLx6IdBKSumHSyV2ncRWbtbwWfg4j7iPSMFgyo5c1IQ1GaeCy8NQ==',key_name='tempest-keypair-790246539',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:19:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34629163159f48e5a7e45cc79cd11abb',ramdisk_id='',reservation_id='r-rlllv1i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-912489320',owner_user_name='tempest-ServerActionsV293TestJSON-912489320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:19:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='112ea992e8a5439d80ab8032c5f4074d',uuid=d497d108-2eb4-448d-9d1f-e8864e0b48a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converting VIF {"id": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "address": "fa:16:3e:e3:63:a2", "network": {"id": "76ed9cd2-ed10-4200-9a1b-3e6d789eef10", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1643846090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34629163159f48e5a7e45cc79cd11abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c01998-6d", "ovs_interfaceid": "64c01998-6dfe-48d7-8e96-baf6a9cce100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_vif [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64c01998-6d, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=638a8987-91a4-49ab-9617-c672115a292e) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:21:17 user nova-compute[74658]: INFO os_vif [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:63:a2,bridge_name='br-int',has_traffic_filtering=True,id=64c01998-6dfe-48d7-8e96-baf6a9cce100,network=Network(76ed9cd2-ed10-4200-9a1b-3e6d789eef10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c01998-6d')
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRGUKVeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:21:17 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca48e4-9ac0-4f5a-8589-d1acd9af6b15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:21:17 user nova-compute[74658]: No targets found.
Nov 16 15:21:17 user nova-compute[74658]: iSNS:
Nov 16 15:21:17 user nova-compute[74658]: No targets found.
Nov 16 15:21:17 user nova-compute[74658]: STATIC:
Nov 16 15:21:17 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29
Nov 16 15:21:17 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:21:17 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:21:17 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:21:17 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:21:17 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:21:17 user nova-compute[74658]: FIRMWARE:
Nov 16 15:21:17 user nova-compute[74658]: No targets found.
Nov 16 15:21:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:21:17 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:21:17 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.301s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad40f602-6573-4a2d-8bc5-88e7545dad86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk 1073741824" returned: 0 in 0.091s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.396s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5fffa7-7cba-4e72-adca-2825e7574b3e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:21:17 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 (non-flash)
Nov 16 15:21:17 user nova-compute[74658]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710142680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29'): ({'sdj'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Removing single pathed devices sdj {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a81e61a-52d2-439a-8b89-4d346e8a39f4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1171d33c-8744-484f-8437-af758b0c661d]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Flushing IO for device /dev/sdj {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02b4465-1fba-4ac5-9796-bfad9c89f2ea]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.241s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.125s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3da28b0-f455-4391-ad6a-367893e7c931]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] SCSI volumes sdj have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c777ce6-f94d-45be-a936-be3f44c67451]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12b0a7b-f3c2-4588-9c36-2084f01c17d6]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260]
Nov 16 15:21:17 user nova-compute[74658]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29, portal: 172.16.0.220,3260] successful.
Nov 16 15:21:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Instance spawned successfully.
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b36d65-b871-4dbe-88b0-eea4eae50d29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f08f81-368c-46b0-bff1-f114095d0643]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.569s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] <== disconnect_volume: return (570ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:21:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Deleting instance files /opt/stack/data/nova/instances/d497d108-2eb4-448d-9d1f-e8864e0b48a4_del
Nov 16 15:21:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Deletion of /opt/stack/data/nova/instances/d497d108-2eb4-448d-9d1f-e8864e0b48a4_del complete
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Cannot resize image /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Ensure instance console log exists: /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:17 user nova-compute[74658]: INFO nova.compute.manager [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 16 15:21:17 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:21:17 user nova-compute[74658]: INFO nova.compute.manager [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 16 15:21:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:21:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:18 user nova-compute[74658]: INFO nova.compute.manager [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Took 8.91 seconds to build instance.
Nov 16 15:21:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2eaaba85-b461-4bf3-af30-f83a7acdc8fc tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.051s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:19 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Took 1.13 seconds to deallocate network for instance.
Nov 16 15:21:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-94d29194-15af-4677-aff4-0f9019690c6f req-d4083780-3b09-4f8d-b6de-70a1e60f5e7f service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-vif-deleted-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:19 user nova-compute[74658]: INFO nova.compute.manager [req-94d29194-15af-4677-aff4-0f9019690c6f req-d4083780-3b09-4f8d-b6de-70a1e60f5e7f service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Neutron deleted interface 64c01998-6dfe-48d7-8e96-baf6a9cce100; detaching it from the instance and deleting it from the info cache
Nov 16 15:21:19 user nova-compute[74658]: DEBUG nova.network.neutron [req-94d29194-15af-4677-aff4-0f9019690c6f req-d4083780-3b09-4f8d-b6de-70a1e60f5e7f service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] No waiting events found dispatching network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:19 user nova-compute[74658]: WARNING nova.compute.manager [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received unexpected event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 for instance with vm_state active and task_state deleting.
Nov 16 15:21:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] Acquiring lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] No waiting events found dispatching network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:19 user nova-compute[74658]: WARNING nova.compute.manager [req-95c388be-fdf9-4c68-96d1-fd88a0a99328 req-d89558ba-3d3d-4bf6-a965-881a546b78cd service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Received unexpected event network-vif-plugged-64c01998-6dfe-48d7-8e96-baf6a9cce100 for instance with vm_state active and task_state deleting.
Nov 16 15:21:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Successfully created port: 3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-94d29194-15af-4677-aff4-0f9019690c6f req-d4083780-3b09-4f8d-b6de-70a1e60f5e7f service nova] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Detach interface failed, port_id=64c01998-6dfe-48d7-8e96-baf6a9cce100, reason: Instance d497d108-2eb4-448d-9d1f-e8864e0b48a4 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:21:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Starting finish_migration {{(pid=74658) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance directory exists: not creating {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 15:21:20 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Creating image(s)
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:20 user nova-compute[74658]: INFO nova.compute.manager [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Took 1.07 seconds to detach 1 volumes for instance.
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] [instance: d497d108-2eb4-448d-9d1f-e8864e0b48a4] Deleting volume: c0b36d65-b871-4dbe-88b0-eea4eae50d29 {{(pid=74658) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.220s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk. size=21474836480 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-5ad131e6-f5ba-4e83-a007-da41086d3efd req-9420c0c0-41e9-4454-a8f8-a71b7179c56c service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Received event network-vif-plugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5ad131e6-f5ba-4e83-a007-da41086d3efd req-9420c0c0-41e9-4454-a8f8-a71b7179c56c service nova] Acquiring lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5ad131e6-f5ba-4e83-a007-da41086d3efd req-9420c0c0-41e9-4454-a8f8-a71b7179c56c service nova] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5ad131e6-f5ba-4e83-a007-da41086d3efd req-9420c0c0-41e9-4454-a8f8-a71b7179c56c service nova] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-5ad131e6-f5ba-4e83-a007-da41086d3efd req-9420c0c0-41e9-4454-a8f8-a71b7179c56c service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] No waiting events found dispatching network-vif-plugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:20 user nova-compute[74658]: WARNING nova.compute.manager [req-5ad131e6-f5ba-4e83-a007-da41086d3efd req-9420c0c0-41e9-4454-a8f8-a71b7179c56c service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Received unexpected event network-vif-plugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 for instance with vm_state active and task_state None.
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk 21474836480 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk 21474836480" returned: 0 in 0.283s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Ensure instance console log exists: /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Start _get_guest_xml network_info=[{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1435805198-network", "vif_mac": "fa:16:3e:83:53:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f2f4af52-0a54-4c99-8b2a-60249782bea1', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZfabDrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '51f00d67-ae3d-4d1b-a721-280bae2e9caf', 'attached_at': '2023-11-16T15:21:20.000000', 'detached_at': '', 'volume_id': 'bb4b2049-384a-4e93-a6ce-2b020659e81d', 'serial': 'bb4b2049-384a-4e93-a6ce-2b020659e81d'}, 'boot_index': None, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.network.neutron [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Successfully updated port: 3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquired lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.network.neutron [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:21:20 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:21:20 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZfabDrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:21:20 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:21:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:21:20 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:21:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:21:20 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:21:20 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Deleted allocations for instance d497d108-2eb4-448d-9d1f-e8864e0b48a4
Nov 16 15:21:20 user nova-compute[74658]: DEBUG nova.network.neutron [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26fef3a-271c-426d-a26e-fce71a03f123]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:21:20 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a44d759-0b02-4e96-849f-58be8fc50b4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d] added
Nov 16 15:21:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f92ad47-cc5d-4aac-bb6d-ca83a2efbbb6]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-666d4424-56c6-45ad-977d-a5cf753bf085 tempest-ServerActionsV293TestJSON-912489320 tempest-ServerActionsV293TestJSON-912489320-project-member] Lock "d497d108-2eb4-448d-9d1f-e8864e0b48a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.733s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e51e19-a2dc-4119-a251-5328114b39f8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZfabDrQ {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZfabDrQ" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[481c8fe0-7ae6-4142-b60f-7882ab4627ec]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZfabDrQ'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb73309d-0660-44ab-8019-7705bae90bd9]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[02057917-5b1d-468b-a1f9-99b94f9e12ae]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-79d1897b-3d3c-41e9-97b5-ff76d440e871 req-045c794f-4fc4-48a9-ac1c-91078ebffe07 service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Received event network-changed-3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-79d1897b-3d3c-41e9-97b5-ff76d440e871 req-045c794f-4fc4-48a9-ac1c-91078ebffe07 service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Refreshing instance network info cache due to event network-changed-3c1d2da0-50ce-4a45-b959-9d864ca98a79. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-79d1897b-3d3c-41e9-97b5-ff76d440e871 req-045c794f-4fc4-48a9-ac1c-91078ebffe07 service nova] Acquiring lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9123481-6ca9-484a-b462-b6d573545542]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]
Nov 16 15:21:21 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.
Nov 16 15:21:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6055ddf6-42e8-44e6-86a1-6bd4d421a392]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dd1d5a-f9fd-4963-9460-e7ac44368b57]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:21 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:21 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82ddf4f-9ef1-4292-acd5-2e318fe8c644]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZfabDrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.network.neutron [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Updating instance_info_cache with network_info: [{"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Releasing lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Instance network_info: |[{"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-79d1897b-3d3c-41e9-97b5-ff76d440e871 req-045c794f-4fc4-48a9-ac1c-91078ebffe07 service nova] Acquired lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.network.neutron [req-79d1897b-3d3c-41e9-97b5-ff76d440e871 req-045c794f-4fc4-48a9-ac1c-91078ebffe07 service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Refreshing network info cache for port 3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Start _get_guest_xml network_info=[{"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:21:21 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:21:21 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2022950601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2022950601',id=16,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621284eebf704320bacac96aedbc77a4',ramdisk_id='',reservation_id='r-vutb0h15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:17Z,user_data=None,user_id='6ed5db501b2e4dcfb742e18dfdeae88b',uuid=766f2096-3fe3-4d6f-93cd-2a07c8967197,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converting VIF {"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f6:1c,bridge_name='br-int',has_traffic_filtering=True,id=3c1d2da0-50ce-4a45-b959-9d864ca98a79,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1d2da0-50') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.objects.instance [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'pci_devices' on Instance uuid 766f2096-3fe3-4d6f-93cd-2a07c8967197 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:21:21 user nova-compute[74658]:   <uuid>766f2096-3fe3-4d6f-93cd-2a07c8967197</uuid>
Nov 16 15:21:21 user nova-compute[74658]:   <name>instance-00000010</name>
Nov 16 15:21:21 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:21:21 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:21:21 user nova-compute[74658]:   <metadata>
Nov 16 15:21:21 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:21:21 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:21:21 user nova-compute[74658]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2022950601</nova:name>
Nov 16 15:21:21 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:21:21</nova:creationTime>
Nov 16 15:21:21 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:21:21 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:21:21 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:21:21 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:21:21 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:21:21 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:21:21 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:21:21 user nova-compute[74658]:       <nova:owner>
Nov 16 15:21:21 user nova-compute[74658]:         <nova:user uuid="6ed5db501b2e4dcfb742e18dfdeae88b">tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member</nova:user>
Nov 16 15:21:21 user nova-compute[74658]:         <nova:project uuid="621284eebf704320bacac96aedbc77a4">tempest-ServerBootFromVolumeStableRescueTest-1170309652</nova:project>
Nov 16 15:21:21 user nova-compute[74658]:       </nova:owner>
Nov 16 15:21:21 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:21:21 user nova-compute[74658]:       <nova:ports>
Nov 16 15:21:21 user nova-compute[74658]:         <nova:port uuid="3c1d2da0-50ce-4a45-b959-9d864ca98a79">
Nov 16 15:21:21 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 15:21:21 user nova-compute[74658]:         </nova:port>
Nov 16 15:21:21 user nova-compute[74658]:       </nova:ports>
Nov 16 15:21:21 user nova-compute[74658]:     </nova:instance>
Nov 16 15:21:21 user nova-compute[74658]:   </metadata>
Nov 16 15:21:21 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:21:21 user nova-compute[74658]:     <system>
Nov 16 15:21:21 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:21:21 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:21:21 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:21:21 user nova-compute[74658]:       <entry name="serial">766f2096-3fe3-4d6f-93cd-2a07c8967197</entry>
Nov 16 15:21:21 user nova-compute[74658]:       <entry name="uuid">766f2096-3fe3-4d6f-93cd-2a07c8967197</entry>
Nov 16 15:21:21 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:21:21 user nova-compute[74658]:     </system>
Nov 16 15:21:21 user nova-compute[74658]:   </sysinfo>
Nov 16 15:21:21 user nova-compute[74658]:   <os>
Nov 16 15:21:21 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:21:21 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:21:21 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:21:21 user nova-compute[74658]:   </os>
Nov 16 15:21:21 user nova-compute[74658]:   <features>
Nov 16 15:21:21 user nova-compute[74658]:     <acpi/>
Nov 16 15:21:21 user nova-compute[74658]:     <apic/>
Nov 16 15:21:21 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:21:21 user nova-compute[74658]:   </features>
Nov 16 15:21:21 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:21:21 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:21:21 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:21:21 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:21:21 user nova-compute[74658]:   </clock>
Nov 16 15:21:21 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:21:21 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:21:21 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:21:21 user nova-compute[74658]:   </cpu>
Nov 16 15:21:21 user nova-compute[74658]:   <devices>
Nov 16 15:21:21 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:21:21 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:21:21 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk"/>
Nov 16 15:21:21 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:21:21 user nova-compute[74658]:     </disk>
Nov 16 15:21:21 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:21:21 user nova-compute[74658]:       <mac address="fa:16:3e:2e:f6:1c"/>
Nov 16 15:21:21 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:21:21 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:21:21 user nova-compute[74658]:       <target dev="tap3c1d2da0-50"/>
Nov 16 15:21:21 user nova-compute[74658]:     </interface>
Nov 16 15:21:21 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:21:21 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/console.log" append="off"/>
Nov 16 15:21:21 user nova-compute[74658]:     </serial>
Nov 16 15:21:21 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:21:21 user nova-compute[74658]:     <video>
Nov 16 15:21:21 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:21:21 user nova-compute[74658]:     </video>
Nov 16 15:21:21 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:21:21 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:21:21 user nova-compute[74658]:     </rng>
Nov 16 15:21:21 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:21:21 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:21:21 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:21:21 user nova-compute[74658]:     </memballoon>
Nov 16 15:21:21 user nova-compute[74658]:   </devices>
Nov 16 15:21:21 user nova-compute[74658]: </domain>
Nov 16 15:21:21 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2022950601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2022950601',id=16,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621284eebf704320bacac96aedbc77a4',ramdisk_id='',reservation_id='r-vutb0h15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:17Z,user_data=None,user_id='6ed5db501b2e4dcfb742e18dfdeae88b',uuid=766f2096-3fe3-4d6f-93cd-2a07c8967197,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converting VIF {"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f6:1c,bridge_name='br-int',has_traffic_filtering=True,id=3c1d2da0-50ce-4a45-b959-9d864ca98a79,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1d2da0-50') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG os_vif [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f6:1c,bridge_name='br-int',has_traffic_filtering=True,id=3c1d2da0-50ce-4a45-b959-9d864ca98a79,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1d2da0-50') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39ea8bf9-338c-5c7b-bb46-bf887411bda8', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c1d2da0-50, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c1d2da0-50, col_values=(('qos', UUID('d605af99-b27f-4dc0-809f-ca6cea6f456f')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c1d2da0-50, col_values=(('external_ids', {'iface-id': '3c1d2da0-50ce-4a45-b959-9d864ca98a79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:f6:1c', 'vm-uuid': '766f2096-3fe3-4d6f-93cd-2a07c8967197'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:21 user nova-compute[74658]: INFO os_vif [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f6:1c,bridge_name='br-int',has_traffic_filtering=True,id=3c1d2da0-50ce-4a45-b959-9d864ca98a79,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1d2da0-50')
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] No VIF found with MAC fa:16:3e:2e:f6:1c, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.network.neutron [req-79d1897b-3d3c-41e9-97b5-ff76d440e871 req-045c794f-4fc4-48a9-ac1c-91078ebffe07 service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Updated VIF entry in instance network info cache for port 3c1d2da0-50ce-4a45-b959-9d864ca98a79. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG nova.network.neutron [req-79d1897b-3d3c-41e9-97b5-ff76d440e871 req-045c794f-4fc4-48a9-ac1c-91078ebffe07 service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Updating instance_info_cache with network_info: [{"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-79d1897b-3d3c-41e9-97b5-ff76d440e871 req-045c794f-4fc4-48a9-ac1c-91078ebffe07 service nova] Releasing lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23131386261666362', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131386261666362', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-e88b7b76-c972-4da3-a18d-321659bfbffb req-43be475e-cdff-4c48-a78b-1fa5516ec7e8 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Received event network-vif-plugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e88b7b76-c972-4da3-a18d-321659bfbffb req-43be475e-cdff-4c48-a78b-1fa5516ec7e8 service nova] Acquiring lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e88b7b76-c972-4da3-a18d-321659bfbffb req-43be475e-cdff-4c48-a78b-1fa5516ec7e8 service nova] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e88b7b76-c972-4da3-a18d-321659bfbffb req-43be475e-cdff-4c48-a78b-1fa5516ec7e8 service nova] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-e88b7b76-c972-4da3-a18d-321659bfbffb req-43be475e-cdff-4c48-a78b-1fa5516ec7e8 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] No waiting events found dispatching network-vif-plugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:22 user nova-compute[74658]: WARNING nova.compute.manager [req-e88b7b76-c972-4da3-a18d-321659bfbffb req-43be475e-cdff-4c48-a78b-1fa5516ec7e8 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Received unexpected event network-vif-plugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 for instance with vm_state active and task_state None.
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1901009930',display_name='tempest-ServerActionsTestOtherB-server-1901009930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1901009930',id=5,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfYsAQlC3nkxAyuTL+KN50dEAunY5gw1KQEIPq+iR4mJ4asJBSmjta4eGNIIDBn+5Mv+AkdxZhEfTWggAEXb2LpORaOL7hjybIPHi4K1ldg1rK7G6KYvZmZ7N35zLKD+g==',key_name='tempest-keypair-983162783',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1e465eeac8f4bc5b11c0a6e3a7bbc61',ramdisk_id='',reservation_id='r-gupt4lp1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-662756880',owner_user_name='tempest-ServerActionsTestOtherB-662756880-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aa837a8e0f14644a3b6b0d3904213f2',uuid=51f00d67-ae3d-4d1b-a721-280bae2e9caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1435805198-network", "vif_mac": "fa:16:3e:83:53:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converting VIF {"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1435805198-network", "vif_mac": "fa:16:3e:83:53:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:21:22 user nova-compute[74658]:   <uuid>51f00d67-ae3d-4d1b-a721-280bae2e9caf</uuid>
Nov 16 15:21:22 user nova-compute[74658]:   <name>instance-00000005</name>
Nov 16 15:21:22 user nova-compute[74658]:   <memory>2097152</memory>
Nov 16 15:21:22 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:21:22 user nova-compute[74658]:   <metadata>
Nov 16 15:21:22 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:21:22 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:21:22 user nova-compute[74658]:       <nova:name>tempest-ServerActionsTestOtherB-server-1901009930</nova:name>
Nov 16 15:21:22 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:21:20</nova:creationTime>
Nov 16 15:21:22 user nova-compute[74658]:       <nova:flavor name="m1.small">
Nov 16 15:21:22 user nova-compute[74658]:         <nova:memory>2048</nova:memory>
Nov 16 15:21:22 user nova-compute[74658]:         <nova:disk>20</nova:disk>
Nov 16 15:21:22 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:21:22 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:21:22 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:21:22 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:21:22 user nova-compute[74658]:       <nova:owner>
Nov 16 15:21:22 user nova-compute[74658]:         <nova:user uuid="9aa837a8e0f14644a3b6b0d3904213f2">tempest-ServerActionsTestOtherB-662756880-project-member</nova:user>
Nov 16 15:21:22 user nova-compute[74658]:         <nova:project uuid="f1e465eeac8f4bc5b11c0a6e3a7bbc61">tempest-ServerActionsTestOtherB-662756880</nova:project>
Nov 16 15:21:22 user nova-compute[74658]:       </nova:owner>
Nov 16 15:21:22 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:21:22 user nova-compute[74658]:       <nova:ports>
Nov 16 15:21:22 user nova-compute[74658]:         <nova:port uuid="6abed81e-257d-4d47-a1b8-586c040fdc92">
Nov 16 15:21:22 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 15:21:22 user nova-compute[74658]:         </nova:port>
Nov 16 15:21:22 user nova-compute[74658]:       </nova:ports>
Nov 16 15:21:22 user nova-compute[74658]:     </nova:instance>
Nov 16 15:21:22 user nova-compute[74658]:   </metadata>
Nov 16 15:21:22 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:21:22 user nova-compute[74658]:     <system>
Nov 16 15:21:22 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:21:22 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:21:22 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:21:22 user nova-compute[74658]:       <entry name="serial">51f00d67-ae3d-4d1b-a721-280bae2e9caf</entry>
Nov 16 15:21:22 user nova-compute[74658]:       <entry name="uuid">51f00d67-ae3d-4d1b-a721-280bae2e9caf</entry>
Nov 16 15:21:22 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:21:22 user nova-compute[74658]:     </system>
Nov 16 15:21:22 user nova-compute[74658]:   </sysinfo>
Nov 16 15:21:22 user nova-compute[74658]:   <os>
Nov 16 15:21:22 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:21:22 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:21:22 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:21:22 user nova-compute[74658]:   </os>
Nov 16 15:21:22 user nova-compute[74658]:   <features>
Nov 16 15:21:22 user nova-compute[74658]:     <acpi/>
Nov 16 15:21:22 user nova-compute[74658]:     <apic/>
Nov 16 15:21:22 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:21:22 user nova-compute[74658]:   </features>
Nov 16 15:21:22 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:21:22 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:21:22 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:21:22 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:21:22 user nova-compute[74658]:   </clock>
Nov 16 15:21:22 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:21:22 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:21:22 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:21:22 user nova-compute[74658]:   </cpu>
Nov 16 15:21:22 user nova-compute[74658]:   <devices>
Nov 16 15:21:22 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:21:22 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:21:22 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk"/>
Nov 16 15:21:22 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:21:22 user nova-compute[74658]:     </disk>
Nov 16 15:21:22 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:21:22 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:21:22 user nova-compute[74658]:       <source dev="/dev/sdc"/>
Nov 16 15:21:22 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:21:22 user nova-compute[74658]:       <serial>bb4b2049-384a-4e93-a6ce-2b020659e81d</serial>
Nov 16 15:21:22 user nova-compute[74658]:     </disk>
Nov 16 15:21:22 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:21:22 user nova-compute[74658]:       <mac address="fa:16:3e:83:53:58"/>
Nov 16 15:21:22 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:21:22 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:21:22 user nova-compute[74658]:       <target dev="tap6abed81e-25"/>
Nov 16 15:21:22 user nova-compute[74658]:     </interface>
Nov 16 15:21:22 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:21:22 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/console.log" append="off"/>
Nov 16 15:21:22 user nova-compute[74658]:     </serial>
Nov 16 15:21:22 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:21:22 user nova-compute[74658]:     <video>
Nov 16 15:21:22 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:21:22 user nova-compute[74658]:     </video>
Nov 16 15:21:22 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:21:22 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:21:22 user nova-compute[74658]:     </rng>
Nov 16 15:21:22 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:21:22 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:21:22 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:21:22 user nova-compute[74658]:     </memballoon>
Nov 16 15:21:22 user nova-compute[74658]:   </devices>
Nov 16 15:21:22 user nova-compute[74658]: </domain>
Nov 16 15:21:22 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1901009930',display_name='tempest-ServerActionsTestOtherB-server-1901009930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1901009930',id=5,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfYsAQlC3nkxAyuTL+KN50dEAunY5gw1KQEIPq+iR4mJ4asJBSmjta4eGNIIDBn+5Mv+AkdxZhEfTWggAEXb2LpORaOL7hjybIPHi4K1ldg1rK7G6KYvZmZ7N35zLKD+g==',key_name='tempest-keypair-983162783',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1e465eeac8f4bc5b11c0a6e3a7bbc61',ramdisk_id='',reservation_id='r-gupt4lp1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-662756880',owner_user_name='tempest-ServerActionsTestOtherB-662756880-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aa837a8e0f14644a3b6b0d3904213f2',uuid=51f00d67-ae3d-4d1b-a721-280bae2e9caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1435805198-network", "vif_mac": "fa:16:3e:83:53:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converting VIF {"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1435805198-network", "vif_mac": "fa:16:3e:83:53:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG os_vif [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48b27d98-e2cd-5680-87f6-fa2549355058', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6abed81e-25, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6abed81e-25, col_values=(('qos', UUID('d7e445e5-0553-4bbc-b593-88bf576e8f8b')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6abed81e-25, col_values=(('external_ids', {'iface-id': '6abed81e-257d-4d47-a1b8-586c040fdc92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:53:58', 'vm-uuid': '51f00d67-ae3d-4d1b-a721-280bae2e9caf'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:22 user nova-compute[74658]: INFO os_vif [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25')
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:21:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] No VIF found with MAC fa:16:3e:83:53:58, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:21:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-60419f48-8311-4cfe-86a5-c46ca3d2d550 req-80edaad9-fa76-4c76-87ca-77d82dc923f8 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-60419f48-8311-4cfe-86a5-c46ca3d2d550 req-80edaad9-fa76-4c76-87ca-77d82dc923f8 service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-60419f48-8311-4cfe-86a5-c46ca3d2d550 req-80edaad9-fa76-4c76-87ca-77d82dc923f8 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-60419f48-8311-4cfe-86a5-c46ca3d2d550 req-80edaad9-fa76-4c76-87ca-77d82dc923f8 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-60419f48-8311-4cfe-86a5-c46ca3d2d550 req-80edaad9-fa76-4c76-87ca-77d82dc923f8 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:25 user nova-compute[74658]: WARNING nova.compute.manager [req-60419f48-8311-4cfe-86a5-c46ca3d2d550 req-80edaad9-fa76-4c76-87ca-77d82dc923f8 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received unexpected event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with vm_state active and task_state resize_finish.
Nov 16 15:21:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-872fe8ec-d1e8-4279-84ca-1ee34fc7db4c req-8e9a9cda-9005-48d9-bd3f-8f15838ed57c service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Received event network-vif-plugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-872fe8ec-d1e8-4279-84ca-1ee34fc7db4c req-8e9a9cda-9005-48d9-bd3f-8f15838ed57c service nova] Acquiring lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-872fe8ec-d1e8-4279-84ca-1ee34fc7db4c req-8e9a9cda-9005-48d9-bd3f-8f15838ed57c service nova] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-872fe8ec-d1e8-4279-84ca-1ee34fc7db4c req-8e9a9cda-9005-48d9-bd3f-8f15838ed57c service nova] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-872fe8ec-d1e8-4279-84ca-1ee34fc7db4c req-8e9a9cda-9005-48d9-bd3f-8f15838ed57c service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] No waiting events found dispatching network-vif-plugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:26 user nova-compute[74658]: WARNING nova.compute.manager [req-872fe8ec-d1e8-4279-84ca-1ee34fc7db4c req-8e9a9cda-9005-48d9-bd3f-8f15838ed57c service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Received unexpected event network-vif-plugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 for instance with vm_state building and task_state spawning.
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:21:27 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Instance spawned successfully.
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.compute.manager [req-835c6ac7-c1e1-442d-b9f0-97ddd6ec634f req-c22fd7fc-180b-4f33-8e1c-d4744f63a852 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-835c6ac7-c1e1-442d-b9f0-97ddd6ec634f req-c22fd7fc-180b-4f33-8e1c-d4744f63a852 service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-835c6ac7-c1e1-442d-b9f0-97ddd6ec634f req-c22fd7fc-180b-4f33-8e1c-d4744f63a852 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-835c6ac7-c1e1-442d-b9f0-97ddd6ec634f req-c22fd7fc-180b-4f33-8e1c-d4744f63a852 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.compute.manager [req-835c6ac7-c1e1-442d-b9f0-97ddd6ec634f req-c22fd7fc-180b-4f33-8e1c-d4744f63a852 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:27 user nova-compute[74658]: WARNING nova.compute.manager [req-835c6ac7-c1e1-442d-b9f0-97ddd6ec634f req-c22fd7fc-180b-4f33-8e1c-d4744f63a852 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received unexpected event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with vm_state active and task_state resize_finish.
Nov 16 15:21:27 user nova-compute[74658]: INFO nova.compute.manager [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Took 10.63 seconds to spawn the instance on the hypervisor.
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:21:27 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance running successfully.
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Failed to set time: agent not configured {{(pid=74658) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-006b8621-8d3d-47a8-9a9a-ea903a63e184 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] finish_migration finished successfully. {{(pid=74658) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 15:21:27 user nova-compute[74658]: INFO nova.compute.manager [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Took 11.77 seconds to build instance.
Nov 16 15:21:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-519619b3-1ee5-4191-bd63-9b8c584bfda4 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.924s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-b0c18ae0-69ca-4621-8d70-d9e7f3efc7fe req-eace4ea8-2453-4ffc-8759-e9c44d13baa8 service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Received event network-vif-plugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b0c18ae0-69ca-4621-8d70-d9e7f3efc7fe req-eace4ea8-2453-4ffc-8759-e9c44d13baa8 service nova] Acquiring lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b0c18ae0-69ca-4621-8d70-d9e7f3efc7fe req-eace4ea8-2453-4ffc-8759-e9c44d13baa8 service nova] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b0c18ae0-69ca-4621-8d70-d9e7f3efc7fe req-eace4ea8-2453-4ffc-8759-e9c44d13baa8 service nova] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-b0c18ae0-69ca-4621-8d70-d9e7f3efc7fe req-eace4ea8-2453-4ffc-8759-e9c44d13baa8 service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] No waiting events found dispatching network-vif-plugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:21:28 user nova-compute[74658]: WARNING nova.compute.manager [req-b0c18ae0-69ca-4621-8d70-d9e7f3efc7fe req-eace4ea8-2453-4ffc-8759-e9c44d13baa8 service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Received unexpected event network-vif-plugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 for instance with vm_state active and task_state None.
Nov 16 15:21:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:41 user nova-compute[74658]: DEBUG nova.compute.manager [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:21:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:41 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:21:41 user nova-compute[74658]: INFO nova.compute.claims [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Claim successful on node user
Nov 16 15:21:41 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:21:41 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:21:42 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:21:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:21:42 user nova-compute[74658]: INFO nova.virt.block_device [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Booting with volume d7c7f1e0-96ba-45e8-802a-1c93e3347c00 at /dev/vda
Nov 16 15:21:42 user nova-compute[74658]: DEBUG os_brick.utils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5110fa6-1374-4317-ac1c-9a8d091da117]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe57d28-17d2-4bf8-a6b0-e37f63a26b6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1bd15d-ccc6-49c4-a851-b6c6471a6a77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d41f92e-b355-44db-a5a9-1c691b9005b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:21:42 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:21:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c78bec-7e95-49ab-825f-277b6f7421d2]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG os_brick.utils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating existing volume attachment record: 28829de5-72fa-4b88-a1f5-2e7c2cd7e39f {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG nova.policy [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30e8f5be4a304d57ba6bb75daa7fad6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76870740e0af4590bb1978d56350b2d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:21:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:43 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully created port: 4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:21:43 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully created port: 68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:21:44 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully created port: 6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:21:44 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully created port: eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:21:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:45 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully created port: 914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:21:46 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully updated port: 4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:21:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-d1333340-ad94-4bef-aae1-7442d0ee621f req-429340ee-6c96-4641-9a40-5257d181bff0 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-changed-4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-d1333340-ad94-4bef-aae1-7442d0ee621f req-429340ee-6c96-4641-9a40-5257d181bff0 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing instance network info cache due to event network-changed-4ee3a8b1-11de-4a46-9882-792af7e1b625. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:21:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d1333340-ad94-4bef-aae1-7442d0ee621f req-429340ee-6c96-4641-9a40-5257d181bff0 service nova] Acquiring lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d1333340-ad94-4bef-aae1-7442d0ee621f req-429340ee-6c96-4641-9a40-5257d181bff0 service nova] Acquired lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:46 user nova-compute[74658]: DEBUG nova.network.neutron [req-d1333340-ad94-4bef-aae1-7442d0ee621f req-429340ee-6c96-4641-9a40-5257d181bff0 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing network info cache for port 4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:21:46 user nova-compute[74658]: DEBUG nova.network.neutron [req-d1333340-ad94-4bef-aae1-7442d0ee621f req-429340ee-6c96-4641-9a40-5257d181bff0 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:21:46 user nova-compute[74658]: DEBUG nova.network.neutron [req-d1333340-ad94-4bef-aae1-7442d0ee621f req-429340ee-6c96-4641-9a40-5257d181bff0 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d1333340-ad94-4bef-aae1-7442d0ee621f req-429340ee-6c96-4641-9a40-5257d181bff0 service nova] Releasing lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully updated port: 625eadf6-4b3f-4dda-ac0a-33bdde1e938c {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:21:47 user nova-compute[74658]: INFO nova.virt.block_device [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Booting with volume 4f5069ae-9be0-47e5-8274-48d9b2264918 at /dev/vdb
Nov 16 15:21:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG os_brick.utils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6a0b07-21a4-46f7-96f1-58a6eb5d580f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[49367f33-13f9-4165-9aa9-ae25a627306e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93c8327-ec5d-45fa-a743-c6f5d533338d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b3ce1e-134d-49cd-af63-651dcea9eb54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:21:47 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:21:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8364eb94-9d96-46f7-90a2-f53c0a4af573]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG os_brick.utils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:21:47 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating existing volume attachment record: 8d4e176b-6ec0-48fb-9e93-ae0a0586a8d3 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:21:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-1fa8aa56-f686-41fc-9c7e-bfe28458a44b req-eabd4c7e-7a98-4297-aeb2-5439bc5b7589 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-changed-625eadf6-4b3f-4dda-ac0a-33bdde1e938c {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-1fa8aa56-f686-41fc-9c7e-bfe28458a44b req-eabd4c7e-7a98-4297-aeb2-5439bc5b7589 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing instance network info cache due to event network-changed-625eadf6-4b3f-4dda-ac0a-33bdde1e938c. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:21:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1fa8aa56-f686-41fc-9c7e-bfe28458a44b req-eabd4c7e-7a98-4297-aeb2-5439bc5b7589 service nova] Acquiring lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1fa8aa56-f686-41fc-9c7e-bfe28458a44b req-eabd4c7e-7a98-4297-aeb2-5439bc5b7589 service nova] Acquired lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:48 user nova-compute[74658]: DEBUG nova.network.neutron [req-1fa8aa56-f686-41fc-9c7e-bfe28458a44b req-eabd4c7e-7a98-4297-aeb2-5439bc5b7589 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing network info cache for port 625eadf6-4b3f-4dda-ac0a-33bdde1e938c {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:21:48 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully updated port: 593b4c31-e20e-46a4-ae7f-33b951762c4a {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:21:48 user nova-compute[74658]: DEBUG nova.network.neutron [req-1fa8aa56-f686-41fc-9c7e-bfe28458a44b req-eabd4c7e-7a98-4297-aeb2-5439bc5b7589 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:21:49 user nova-compute[74658]: DEBUG nova.network.neutron [req-1fa8aa56-f686-41fc-9c7e-bfe28458a44b req-eabd4c7e-7a98-4297-aeb2-5439bc5b7589 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1fa8aa56-f686-41fc-9c7e-bfe28458a44b req-eabd4c7e-7a98-4297-aeb2-5439bc5b7589 service nova] Releasing lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:49 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully updated port: 68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:21:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:50 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully updated port: 6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:21:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-changed-593b4c31-e20e-46a4-ae7f-33b951762c4a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing instance network info cache due to event network-changed-593b4c31-e20e-46a4-ae7f-33b951762c4a. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:21:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] Acquiring lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] Acquired lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:50 user nova-compute[74658]: DEBUG nova.network.neutron [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing network info cache for port 593b4c31-e20e-46a4-ae7f-33b951762c4a {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:21:50 user nova-compute[74658]: DEBUG nova.network.neutron [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG nova.network.neutron [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] Releasing lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-changed-68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing instance network info cache due to event network-changed-68d9dea1-bd8e-45b5-9f04-90bc3879e48c. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] Acquiring lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] Acquired lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG nova.network.neutron [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing network info cache for port 68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully updated port: eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG nova.network.neutron [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG nova.network.neutron [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] Releasing lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-changed-6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing instance network info cache due to event network-changed-6d1585ce-3521-411d-bafd-e1bd7a147cbb. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] Acquiring lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] Acquired lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG nova.network.neutron [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing network info cache for port 6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:21:51 user nova-compute[74658]: DEBUG nova.network.neutron [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG nova.network.neutron [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-349bf744-a9f3-4edf-a5f6-26e8289b3772 req-8c5c76ea-c1b9-4253-b4aa-c6b3807913a7 service nova] Releasing lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Successfully updated port: 914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquired lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-changed-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing instance network info cache due to event network-changed-eafee381-ea25-4cd4-8a86-a4e61b15c9a6. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] Acquiring lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:52 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:21:53 user nova-compute[74658]: INFO nova.virt.block_device [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Booting with volume 5280c452-4add-4c94-9e9a-92110d726458 at /dev/vdc
Nov 16 15:21:53 user nova-compute[74658]: DEBUG os_brick.utils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bf1a08-e63d-4952-b3df-97021224d2ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[afffcc1f-b3f3-49dc-b799-5a127eedc96e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afc54f0-d6b3-40a6-b491-5bd1ffeedb0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc763cf4-5f56-472c-99eb-60d83c4baf28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:21:53 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:21:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7921328e-7430-4c89-b789-1c9da0da94e4]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG os_brick.utils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating existing volume attachment record: 1142014e-39b5-44a2-a2f3-007f05b185f5 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:21:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG nova.network.neutron [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating instance_info_cache with network_info: [{"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Releasing lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Instance network_info: |[{"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] Acquired lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing network info cache for port eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updated VIF entry in instance network info cache for port eafee381-ea25-4cd4-8a86-a4e61b15c9a6. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating instance_info_cache with network_info: [{"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] Releasing lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-changed-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing instance network info cache due to event network-changed-914e7ce0-47f2-4022-84fe-b32da8fa9ad1. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] Acquiring lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] Acquired lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:21:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing network info cache for port 914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG nova.network.neutron [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updated VIF entry in instance network info cache for port 914e7ce0-47f2-4022-84fe-b32da8fa9ad1. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG nova.network.neutron [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating instance_info_cache with network_info: [{"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-207f69e0-461c-49e5-a9c0-4482a9fc91bb req-ed413074-3c7a-4d5a-8d2b-ff29f8193e5f service nova] Releasing lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.compute.manager [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:21:58 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Creating image(s)
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Ensure instance console log exists: /opt/stack/data/nova/instances/ddbd0152-96d0-4c58-bda2-a0fe2c905c28/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Start _get_guest_xml network_info=[{"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '28829de5-72fa-4b88-a1f5-2e7c2cd7e39f', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfnQpjho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ddbd0152-96d0-4c58-bda2-a0fe2c905c28', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7c7f1e0-96ba-45e8-802a-1c93e3347c00', 'serial': 'd7c7f1e0-96ba-45e8-802a-1c93e3347c00'}, 'boot_index': 0, 'volume_type': None}, {'attachment_id': '8d4e176b-6ec0-48fb-9e93-ae0a0586a8d3', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMhvwTPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ddbd0152-96d0-4c58-bda2-a0fe2c905c28', 'attached_at': '', 'detached_at': '', 'volume_id': '4f5069ae-9be0-47e5-8274-48d9b2264918', 'serial': '4f5069ae-9be0-47e5-8274-48d9b2264918'}, 'boot_index': 1, 'volume_type': None}, {'attachment_id': '1142014e-39b5-44a2-a2f3-007f05b185f5', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzIymZVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ddbd0152-96d0-4c58-bda2-a0fe2c905c28', 'attached_at': '', 'detached_at': '', 'volume_id': '5280c452-4add-4c94-9e9a-92110d726458', 'serial': '5280c452-4add-4c94-9e9a-92110d726458'}, 'boot_index': 2, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:21:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:21:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfnQpjho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:21:58 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:21:58 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:21:58 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4185805d-e6e9-4a55-8e1a-d5b8964016a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:21:58 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3a6f45-2779-4497-b852-ba68bf55a0c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00] added
Nov 16 15:21:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[890aa583-6b66-42a4-84db-7dd751636ecb]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cba1310-dee0-48e5-8843-d95078a241c7]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfnQpjho {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfnQpjho" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec978dae-b510-428e-b89c-89f628f01cd0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zfnQpjho'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29e6721-5ef9-42b6-8af0-11f9854bfb6a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d8e5ed-8049-43ed-9585-23b394ea8573]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:58 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:21:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:58 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce85b004-1ace-42c0-9806-7d9f8bc1bc23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00, portal: 172.16.0.220,3260]
Nov 16 15:21:59 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00, portal: 172.16.0.220,3260] successful.
Nov 16 15:21:59 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed4dff1-88e3-4c58-baa1-0e5db8c6d395]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c3dc1c-6345-40c4-9399-3d132ed36bad]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:59 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:59 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:21:59 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:21:59 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:21:59 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:21:59 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e5b30e-e150-492d-8caf-13b2138a6036]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:21:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfnQpjho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26162346166636637', 'path': '/dev/sdd'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162346166636637', 'path': '/dev/sdd'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMhvwTPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:22:00 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:22:00 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:22:00 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa139fa8-895e-4d89-b935-626b4c5542b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:22:00 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:00 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:22:00 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7649MB free_disk=25.459762573242188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9f4a6d-100f-48fb-9b0c-18500ac12b11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918] added
Nov 16 15:22:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e824ef3b-aef7-446f-bc07-0ed7e7f632c1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[827bc655-d7e0-4514-aef9-8c1bc2d47101]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMhvwTPe {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMhvwTPe" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ac6aca-a458-406f-b2aa-fd435ae6b61d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gMhvwTPe'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Applying migration context for instance 51f00d67-ae3d-4d1b-a721-280bae2e9caf as it has an incoming, in-progress migration f3c2298c-e980-4f50-b9f1-5bd6118c24c8. Migration status is finished {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 15:22:00 user nova-compute[74658]: INFO nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating resource usage from migration f3c2298c-e980-4f50-b9f1-5bd6118c24c8
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[584d6353-05aa-4e6a-b598-9873e4251924]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a75e9a-46f4-4dd5-a154-67eb4f5b1b76]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:00 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:00 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:00 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:00 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 03cbebbf-5414-4309-bfc1-ec0a67e09a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e06fcb99-9271-48da-ac95-3998d45e6ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 020c2d27-cb9b-4624-acea-e3e4446ccbfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Migration f3c2298c-e980-4f50-b9f1-5bd6118c24c8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 51f00d67-ae3d-4d1b-a721-280bae2e9caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ca6f21ea-8469-4805-9efe-5580a8dcea56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ddbd0152-96d0-4c58-bda2-a0fe2c905c28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3d71d2-2e6b-4ca3-9170-4e1b220ed65a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918, portal: 172.16.0.220,3260]
Nov 16 15:22:00 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918, portal: 172.16.0.220,3260] successful.
Nov 16 15:22:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b60767a-95e4-4526-b73c-d1b30a197a7f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f706cb9-727b-4859-9855-ebb1f403cef3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:01 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:01 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:01 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:01 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:01 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:01 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:01 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:01 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.852s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d248f0-0f51-4634-a30a-5aed1571d2c8]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMhvwTPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:22:01 user nova-compute[74658]: INFO nova.compute.claims [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Claim successful on node user
Nov 16 15:22:01 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:22:01 user nova-compute[74658]: DEBUG nova.network.neutron [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:22:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:22:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.891s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] <== connect_volume: return (1893ms) {'type': 'block', 'scsi_wwn': '26135666566316430', 'path': '/dev/sde'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135666566316430', 'path': '/dev/sde'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzIymZVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:22:02 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:22:02 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:22:02 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8760a4-f6f9-4cf0-912e-7a2c293e09e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:22:02 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG nova.policy [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa52214955ba4f01a25e5f74699f82b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246582f6f0c74a049de9e4d91f284c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:22:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Creating image(s)
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[49301eff-6114-42a5-a556-effa52f5aea0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458] added
Nov 16 15:22:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb87799f-25ab-4143-9d86-68b4082e1aae]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94db5e7-f457-4fa0-b4d2-9c8f63277ef6]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PzIymZVv {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PzIymZVv" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[222c7038-f35e-4cd5-b398-415e3e24dbf7]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PzIymZVv'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[023739ea-e0a7-4701-8363-e46bacccfc21]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb58eb7-8d20-4f2e-bc1f-75f9346f9a39]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e566362f-af17-49fe-aff0-2fe867aa6e49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458, portal: 172.16.0.220,3260]
Nov 16 15:22:02 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458, portal: 172.16.0.220,3260] successful.
Nov 16 15:22:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1a4cf5-7bb3-47e8-9276-5a8b6fc82503]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1a7e83-a2b0-4e13-9081-d5614e3906bf]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:02 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[961f5af8-c9b6-4da2-b14d-ba8a5ff98c90]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzIymZVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.198s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk 1073741824" returned: 0 in 0.044s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Successfully created port: 7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Cannot resize image /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Ensure instance console log exists: /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23530663034623132', 'path': '/dev/sdf'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530663034623132', 'path': '/dev/sdf'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=4ee3a8b1-11de-4a46-9882-792af7e1b625,network=Network(623a9856-948d-4c92-9256-662df539a75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee3a8b1-11') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=625eadf6-4b3f-4dda-ac0a-33bdde1e938c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap625eadf6-4b') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:c7:f5,bridge_name='br-int',has_traffic_filtering=True,id=593b4c31-e20e-46a4-ae7f-33b951762c4a,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap593b4c31-e2') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:8e,bridge_name='br-int',has_traffic_filtering=True,id=68d9dea1-bd8e-45b5-9f04-90bc3879e48c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d9dea1-bd') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f9:68,bridge_name='br-int',has_traffic_filtering=True,id=6d1585ce-3521-411d-bafd-e1bd7a147cbb,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1585ce-35') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:75:1f,bridge_name='br-int',has_traffic_filtering=True,id=eafee381-ea25-4cd4-8a86-a4e61b15c9a6,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafee381-ea') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=914e7ce0-47f2-4022-84fe-b32da8fa9ad1,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914e7ce0-47') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lazy-loading 'pci_devices' on Instance uuid ddbd0152-96d0-4c58-bda2-a0fe2c905c28 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:22:03 user nova-compute[74658]:   <uuid>ddbd0152-96d0-4c58-bda2-a0fe2c905c28</uuid>
Nov 16 15:22:03 user nova-compute[74658]:   <name>instance-00000011</name>
Nov 16 15:22:03 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:22:03 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:22:03 user nova-compute[74658]:   <metadata>
Nov 16 15:22:03 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:22:03 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:22:03 user nova-compute[74658]:       <nova:name>tempest-device-tagging-server-1675596307</nova:name>
Nov 16 15:22:03 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:21:58</nova:creationTime>
Nov 16 15:22:03 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:22:03 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:22:03 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:22:03 user nova-compute[74658]:       <nova:owner>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:user uuid="30e8f5be4a304d57ba6bb75daa7fad6d">tempest-TaggedBootDevicesTest-1243200656-project-member</nova:user>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:project uuid="76870740e0af4590bb1978d56350b2d0">tempest-TaggedBootDevicesTest-1243200656</nova:project>
Nov 16 15:22:03 user nova-compute[74658]:       </nova:owner>
Nov 16 15:22:03 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:22:03 user nova-compute[74658]:       <nova:ports>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:port uuid="4ee3a8b1-11de-4a46-9882-792af7e1b625">
Nov 16 15:22:03 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 15:22:03 user nova-compute[74658]:         </nova:port>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:port uuid="625eadf6-4b3f-4dda-ac0a-33bdde1e938c">
Nov 16 15:22:03 user nova-compute[74658]:           <nova:ip type="fixed" address="10.1.1.140" ipVersion="4"/>
Nov 16 15:22:03 user nova-compute[74658]:         </nova:port>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:port uuid="593b4c31-e20e-46a4-ae7f-33b951762c4a">
Nov 16 15:22:03 user nova-compute[74658]:           <nova:ip type="fixed" address="10.1.1.133" ipVersion="4"/>
Nov 16 15:22:03 user nova-compute[74658]:         </nova:port>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:port uuid="68d9dea1-bd8e-45b5-9f04-90bc3879e48c">
Nov 16 15:22:03 user nova-compute[74658]:           <nova:ip type="fixed" address="10.1.1.172" ipVersion="4"/>
Nov 16 15:22:03 user nova-compute[74658]:         </nova:port>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:port uuid="6d1585ce-3521-411d-bafd-e1bd7a147cbb">
Nov 16 15:22:03 user nova-compute[74658]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Nov 16 15:22:03 user nova-compute[74658]:         </nova:port>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:port uuid="eafee381-ea25-4cd4-8a86-a4e61b15c9a6">
Nov 16 15:22:03 user nova-compute[74658]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 15:22:03 user nova-compute[74658]:         </nova:port>
Nov 16 15:22:03 user nova-compute[74658]:         <nova:port uuid="914e7ce0-47f2-4022-84fe-b32da8fa9ad1">
Nov 16 15:22:03 user nova-compute[74658]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 15:22:03 user nova-compute[74658]:         </nova:port>
Nov 16 15:22:03 user nova-compute[74658]:       </nova:ports>
Nov 16 15:22:03 user nova-compute[74658]:     </nova:instance>
Nov 16 15:22:03 user nova-compute[74658]:   </metadata>
Nov 16 15:22:03 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:22:03 user nova-compute[74658]:     <system>
Nov 16 15:22:03 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:22:03 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:22:03 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:22:03 user nova-compute[74658]:       <entry name="serial">ddbd0152-96d0-4c58-bda2-a0fe2c905c28</entry>
Nov 16 15:22:03 user nova-compute[74658]:       <entry name="uuid">ddbd0152-96d0-4c58-bda2-a0fe2c905c28</entry>
Nov 16 15:22:03 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:22:03 user nova-compute[74658]:     </system>
Nov 16 15:22:03 user nova-compute[74658]:   </sysinfo>
Nov 16 15:22:03 user nova-compute[74658]:   <os>
Nov 16 15:22:03 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:22:03 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:22:03 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:22:03 user nova-compute[74658]:   </os>
Nov 16 15:22:03 user nova-compute[74658]:   <features>
Nov 16 15:22:03 user nova-compute[74658]:     <acpi/>
Nov 16 15:22:03 user nova-compute[74658]:     <apic/>
Nov 16 15:22:03 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:22:03 user nova-compute[74658]:   </features>
Nov 16 15:22:03 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:22:03 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:22:03 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:22:03 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:22:03 user nova-compute[74658]:   </clock>
Nov 16 15:22:03 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:22:03 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:22:03 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:22:03 user nova-compute[74658]:   </cpu>
Nov 16 15:22:03 user nova-compute[74658]:   <devices>
Nov 16 15:22:03 user nova-compute[74658]:     <disk type="file" device="cdrom">
Nov 16 15:22:03 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 15:22:03 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/ddbd0152-96d0-4c58-bda2-a0fe2c905c28/disk.config"/>
Nov 16 15:22:03 user nova-compute[74658]:       <target dev="hda" bus="ide"/>
Nov 16 15:22:03 user nova-compute[74658]:     </disk>
Nov 16 15:22:03 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:22:03 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:22:03 user nova-compute[74658]:       <source dev="/dev/sdd"/>
Nov 16 15:22:03 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:22:03 user nova-compute[74658]:       <serial>d7c7f1e0-96ba-45e8-802a-1c93e3347c00</serial>
Nov 16 15:22:03 user nova-compute[74658]:     </disk>
Nov 16 15:22:03 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:22:03 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:22:03 user nova-compute[74658]:       <source dev="/dev/sde"/>
Nov 16 15:22:03 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:22:03 user nova-compute[74658]:       <serial>4f5069ae-9be0-47e5-8274-48d9b2264918</serial>
Nov 16 15:22:03 user nova-compute[74658]:     </disk>
Nov 16 15:22:03 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:22:03 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:22:03 user nova-compute[74658]:       <source dev="/dev/sdf"/>
Nov 16 15:22:03 user nova-compute[74658]:       <target dev="vdc" bus="virtio"/>
Nov 16 15:22:03 user nova-compute[74658]:       <serial>5280c452-4add-4c94-9e9a-92110d726458</serial>
Nov 16 15:22:03 user nova-compute[74658]:     </disk>
Nov 16 15:22:03 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:22:03 user nova-compute[74658]:       <mac address="fa:16:3e:e2:78:5e"/>
Nov 16 15:22:03 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:03 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:22:03 user nova-compute[74658]:       <target dev="tap4ee3a8b1-11"/>
Nov 16 15:22:03 user nova-compute[74658]:     </interface>
Nov 16 15:22:03 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:22:03 user nova-compute[74658]:       <mac address="fa:16:3e:a1:16:e5"/>
Nov 16 15:22:03 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:03 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:22:03 user nova-compute[74658]:       <target dev="tap625eadf6-4b"/>
Nov 16 15:22:03 user nova-compute[74658]:     </interface>
Nov 16 15:22:03 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:22:03 user nova-compute[74658]:       <mac address="fa:16:3e:d7:c7:f5"/>
Nov 16 15:22:03 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:03 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:22:03 user nova-compute[74658]:       <target dev="tap593b4c31-e2"/>
Nov 16 15:22:03 user nova-compute[74658]:     </interface>
Nov 16 15:22:03 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:22:03 user nova-compute[74658]:       <mac address="fa:16:3e:a7:57:8e"/>
Nov 16 15:22:03 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:03 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:22:03 user nova-compute[74658]:       <target dev="tap68d9dea1-bd"/>
Nov 16 15:22:03 user nova-compute[74658]:     </interface>
Nov 16 15:22:03 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:22:03 user nova-compute[74658]:       <mac address="fa:16:3e:7f:f9:68"/>
Nov 16 15:22:03 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:03 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:22:03 user nova-compute[74658]:       <target dev="tap6d1585ce-35"/>
Nov 16 15:22:03 user nova-compute[74658]:     </interface>
Nov 16 15:22:03 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:22:03 user nova-compute[74658]:       <mac address="fa:16:3e:c8:75:1f"/>
Nov 16 15:22:03 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:03 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:22:03 user nova-compute[74658]:       <target dev="tapeafee381-ea"/>
Nov 16 15:22:03 user nova-compute[74658]:     </interface>
Nov 16 15:22:03 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:22:03 user nova-compute[74658]:       <mac address="fa:16:3e:4f:a2:94"/>
Nov 16 15:22:03 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:03 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:22:03 user nova-compute[74658]:       <target dev="tap914e7ce0-47"/>
Nov 16 15:22:03 user nova-compute[74658]:     </interface>
Nov 16 15:22:03 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:22:03 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/ddbd0152-96d0-4c58-bda2-a0fe2c905c28/console.log" append="off"/>
Nov 16 15:22:03 user nova-compute[74658]:     </serial>
Nov 16 15:22:03 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:22:03 user nova-compute[74658]:     <video>
Nov 16 15:22:03 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:03 user nova-compute[74658]:     </video>
Nov 16 15:22:03 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:22:03 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:22:03 user nova-compute[74658]:     </rng>
Nov 16 15:22:03 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:22:03 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:22:03 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:22:03 user nova-compute[74658]:     </memballoon>
Nov 16 15:22:03 user nova-compute[74658]:   </devices>
Nov 16 15:22:03 user nova-compute[74658]: </domain>
Nov 16 15:22:03 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=4ee3a8b1-11de-4a46-9882-792af7e1b625,network=Network(623a9856-948d-4c92-9256-662df539a75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee3a8b1-11') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=4ee3a8b1-11de-4a46-9882-792af7e1b625,network=Network(623a9856-948d-4c92-9256-662df539a75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee3a8b1-11') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86db8706-d5c7-5fb4-a8ca-1bc7e9e288c2', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ee3a8b1-11, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ee3a8b1-11, col_values=(('qos', UUID('1ef644bc-fdcb-4fe1-893b-1ab080e873a9')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ee3a8b1-11, col_values=(('external_ids', {'iface-id': '4ee3a8b1-11de-4a46-9882-792af7e1b625', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:78:5e', 'vm-uuid': 'ddbd0152-96d0-4c58-bda2-a0fe2c905c28'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: INFO os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=4ee3a8b1-11de-4a46-9882-792af7e1b625,network=Network(623a9856-948d-4c92-9256-662df539a75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee3a8b1-11')
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=625eadf6-4b3f-4dda-ac0a-33bdde1e938c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap625eadf6-4b') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=625eadf6-4b3f-4dda-ac0a-33bdde1e938c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap625eadf6-4b') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba96f946-639b-58b2-a00a-034ee54e211f', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap625eadf6-4b, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap625eadf6-4b, col_values=(('qos', UUID('5c7f42fe-bc45-4dab-ba54-56cf5b04cab9')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap625eadf6-4b, col_values=(('external_ids', {'iface-id': '625eadf6-4b3f-4dda-ac0a-33bdde1e938c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:16:e5', 'vm-uuid': 'ddbd0152-96d0-4c58-bda2-a0fe2c905c28'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: INFO os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=625eadf6-4b3f-4dda-ac0a-33bdde1e938c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap625eadf6-4b')
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:c7:f5,bridge_name='br-int',has_traffic_filtering=True,id=593b4c31-e20e-46a4-ae7f-33b951762c4a,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap593b4c31-e2') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:c7:f5,bridge_name='br-int',has_traffic_filtering=True,id=593b4c31-e20e-46a4-ae7f-33b951762c4a,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap593b4c31-e2') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c75c37cb-f2ea-5a9e-96f6-e58314fbbc42', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap593b4c31-e2, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap593b4c31-e2, col_values=(('qos', UUID('1b7f26b0-f8af-4053-8d93-80457674d6a9')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap593b4c31-e2, col_values=(('external_ids', {'iface-id': '593b4c31-e20e-46a4-ae7f-33b951762c4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:c7:f5', 'vm-uuid': 'ddbd0152-96d0-4c58-bda2-a0fe2c905c28'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: INFO os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:c7:f5,bridge_name='br-int',has_traffic_filtering=True,id=593b4c31-e20e-46a4-ae7f-33b951762c4a,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap593b4c31-e2')
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:8e,bridge_name='br-int',has_traffic_filtering=True,id=68d9dea1-bd8e-45b5-9f04-90bc3879e48c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d9dea1-bd') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:8e,bridge_name='br-int',has_traffic_filtering=True,id=68d9dea1-bd8e-45b5-9f04-90bc3879e48c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d9dea1-bd') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89dd90d1-d147-54f9-b8f7-0e70a5776226', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68d9dea1-bd, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68d9dea1-bd, col_values=(('qos', UUID('c24f46c1-f029-423f-b578-a9afa2da4e8d')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68d9dea1-bd, col_values=(('external_ids', {'iface-id': '68d9dea1-bd8e-45b5-9f04-90bc3879e48c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:57:8e', 'vm-uuid': 'ddbd0152-96d0-4c58-bda2-a0fe2c905c28'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: INFO os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:8e,bridge_name='br-int',has_traffic_filtering=True,id=68d9dea1-bd8e-45b5-9f04-90bc3879e48c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d9dea1-bd')
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f9:68,bridge_name='br-int',has_traffic_filtering=True,id=6d1585ce-3521-411d-bafd-e1bd7a147cbb,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1585ce-35') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f9:68,bridge_name='br-int',has_traffic_filtering=True,id=6d1585ce-3521-411d-bafd-e1bd7a147cbb,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1585ce-35') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c21ac24-d5c1-5590-b619-71fb97294faf', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d1585ce-35, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d1585ce-35, col_values=(('qos', UUID('a1a0a559-0637-49ef-a92a-0c7b908b1bd7')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d1585ce-35, col_values=(('external_ids', {'iface-id': '6d1585ce-3521-411d-bafd-e1bd7a147cbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:f9:68', 'vm-uuid': 'ddbd0152-96d0-4c58-bda2-a0fe2c905c28'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: INFO os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f9:68,bridge_name='br-int',has_traffic_filtering=True,id=6d1585ce-3521-411d-bafd-e1bd7a147cbb,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1585ce-35')
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:75:1f,bridge_name='br-int',has_traffic_filtering=True,id=eafee381-ea25-4cd4-8a86-a4e61b15c9a6,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafee381-ea') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:75:1f,bridge_name='br-int',has_traffic_filtering=True,id=eafee381-ea25-4cd4-8a86-a4e61b15c9a6,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafee381-ea') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a786efd-7ee5-58e5-a762-2dd440cdb2f3', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Successfully updated port: 7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquired lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-2df24924-f4cc-4993-95e2-6adeb9e08b5a req-1ad26edc-bd9e-4485-b293-240eed126570 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-changed-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-2df24924-f4cc-4993-95e2-6adeb9e08b5a req-1ad26edc-bd9e-4485-b293-240eed126570 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Refreshing instance network info cache due to event network-changed-7835b05b-5b80-4071-9f12-34a63399f7b8. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:22:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2df24924-f4cc-4993-95e2-6adeb9e08b5a req-1ad26edc-bd9e-4485-b293-240eed126570 service nova] Acquiring lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeafee381-ea, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeafee381-ea, col_values=(('qos', UUID('de0410ae-bda5-4f3c-9538-9e6edc7da189')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeafee381-ea, col_values=(('external_ids', {'iface-id': 'eafee381-ea25-4cd4-8a86-a4e61b15c9a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:75:1f', 'vm-uuid': 'ddbd0152-96d0-4c58-bda2-a0fe2c905c28'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: INFO os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:75:1f,bridge_name='br-int',has_traffic_filtering=True,id=eafee381-ea25-4cd4-8a86-a4e61b15c9a6,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafee381-ea')
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=914e7ce0-47f2-4022-84fe-b32da8fa9ad1,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914e7ce0-47') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=914e7ce0-47f2-4022-84fe-b32da8fa9ad1,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914e7ce0-47') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '328f7bdd-f70e-5f50-b639-80a7419f9dfd', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap914e7ce0-47, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap914e7ce0-47, col_values=(('qos', UUID('0737833d-7711-4685-8c33-95e746847e41')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap914e7ce0-47, col_values=(('external_ids', {'iface-id': '914e7ce0-47f2-4022-84fe-b32da8fa9ad1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:a2:94', 'vm-uuid': 'ddbd0152-96d0-4c58-bda2-a0fe2c905c28'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: INFO os_vif [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=914e7ce0-47f2-4022-84fe-b32da8fa9ad1,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914e7ce0-47')
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] No BDM found with device name hda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] No VIF found with MAC fa:16:3e:e2:78:5e, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] No VIF found with MAC fa:16:3e:7f:f9:68, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:22:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Using config drive
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updating instance_info_cache with network_info: [{"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Releasing lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Instance network_info: |[{"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2df24924-f4cc-4993-95e2-6adeb9e08b5a req-1ad26edc-bd9e-4485-b293-240eed126570 service nova] Acquired lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.network.neutron [req-2df24924-f4cc-4993-95e2-6adeb9e08b5a req-1ad26edc-bd9e-4485-b293-240eed126570 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Refreshing network info cache for port 7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Start _get_guest_xml network_info=[{"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:22:04 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:22:04 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-195038505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-195038505',id=18,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUYALn+Qe4bwBouHMM172AwnuDCo8Hub97tHOoN+sL0yYCQQKPRlPEZKYjt7+tYhGGAM1S+tJ0NSYwnH68UBRN5GsdSVFRHkmY5xPtQI9glZ3saVVE/aVmRO8U+qZ4/ZA==',key_name='tempest-keypair-498949403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='246582f6f0c74a049de9e4d91f284c9b',ramdisk_id='',reservation_id='r-jlw5bbtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-281283563',owner_user_name='tempest-TaggedAttachmentsTest-281283563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:22:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa52214955ba4f01a25e5f74699f82b4',uuid=6aa0fa12-4970-442d-ae49-36266e774d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converting VIF {"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:76:63,bridge_name='br-int',has_traffic_filtering=True,id=7835b05b-5b80-4071-9f12-34a63399f7b8,network=Network(9773b97c-d7cf-4ef1-a989-d2e2fde157e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7835b05b-5b') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lazy-loading 'pci_devices' on Instance uuid 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:22:04 user nova-compute[74658]:   <uuid>6aa0fa12-4970-442d-ae49-36266e774d68</uuid>
Nov 16 15:22:04 user nova-compute[74658]:   <name>instance-00000012</name>
Nov 16 15:22:04 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:22:04 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:22:04 user nova-compute[74658]:   <metadata>
Nov 16 15:22:04 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:22:04 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:22:04 user nova-compute[74658]:       <nova:name>tempest-device-tagging-server-195038505</nova:name>
Nov 16 15:22:04 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:22:04</nova:creationTime>
Nov 16 15:22:04 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:22:04 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:22:04 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:22:04 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:22:04 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:22:04 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:22:04 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:22:04 user nova-compute[74658]:       <nova:owner>
Nov 16 15:22:04 user nova-compute[74658]:         <nova:user uuid="aa52214955ba4f01a25e5f74699f82b4">tempest-TaggedAttachmentsTest-281283563-project-member</nova:user>
Nov 16 15:22:04 user nova-compute[74658]:         <nova:project uuid="246582f6f0c74a049de9e4d91f284c9b">tempest-TaggedAttachmentsTest-281283563</nova:project>
Nov 16 15:22:04 user nova-compute[74658]:       </nova:owner>
Nov 16 15:22:04 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:22:04 user nova-compute[74658]:       <nova:ports>
Nov 16 15:22:04 user nova-compute[74658]:         <nova:port uuid="7835b05b-5b80-4071-9f12-34a63399f7b8">
Nov 16 15:22:04 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 15:22:04 user nova-compute[74658]:         </nova:port>
Nov 16 15:22:04 user nova-compute[74658]:       </nova:ports>
Nov 16 15:22:04 user nova-compute[74658]:     </nova:instance>
Nov 16 15:22:04 user nova-compute[74658]:   </metadata>
Nov 16 15:22:04 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:22:04 user nova-compute[74658]:     <system>
Nov 16 15:22:04 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:22:04 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:22:04 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:22:04 user nova-compute[74658]:       <entry name="serial">6aa0fa12-4970-442d-ae49-36266e774d68</entry>
Nov 16 15:22:04 user nova-compute[74658]:       <entry name="uuid">6aa0fa12-4970-442d-ae49-36266e774d68</entry>
Nov 16 15:22:04 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:22:04 user nova-compute[74658]:     </system>
Nov 16 15:22:04 user nova-compute[74658]:   </sysinfo>
Nov 16 15:22:04 user nova-compute[74658]:   <os>
Nov 16 15:22:04 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:22:04 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:22:04 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:22:04 user nova-compute[74658]:   </os>
Nov 16 15:22:04 user nova-compute[74658]:   <features>
Nov 16 15:22:04 user nova-compute[74658]:     <acpi/>
Nov 16 15:22:04 user nova-compute[74658]:     <apic/>
Nov 16 15:22:04 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:22:04 user nova-compute[74658]:   </features>
Nov 16 15:22:04 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:22:04 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:22:04 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:22:04 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:22:04 user nova-compute[74658]:   </clock>
Nov 16 15:22:04 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:22:04 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:22:04 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:22:04 user nova-compute[74658]:   </cpu>
Nov 16 15:22:04 user nova-compute[74658]:   <devices>
Nov 16 15:22:04 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:22:04 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:22:04 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk"/>
Nov 16 15:22:04 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:22:04 user nova-compute[74658]:     </disk>
Nov 16 15:22:04 user nova-compute[74658]:     <disk type="file" device="cdrom">
Nov 16 15:22:04 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 15:22:04 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk.config"/>
Nov 16 15:22:04 user nova-compute[74658]:       <target dev="hda" bus="ide"/>
Nov 16 15:22:04 user nova-compute[74658]:     </disk>
Nov 16 15:22:04 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:22:04 user nova-compute[74658]:       <mac address="fa:16:3e:85:76:63"/>
Nov 16 15:22:04 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:04 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:22:04 user nova-compute[74658]:       <target dev="tap7835b05b-5b"/>
Nov 16 15:22:04 user nova-compute[74658]:     </interface>
Nov 16 15:22:04 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:22:04 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/console.log" append="off"/>
Nov 16 15:22:04 user nova-compute[74658]:     </serial>
Nov 16 15:22:04 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:22:04 user nova-compute[74658]:     <video>
Nov 16 15:22:04 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:04 user nova-compute[74658]:     </video>
Nov 16 15:22:04 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:22:04 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:22:04 user nova-compute[74658]:     </rng>
Nov 16 15:22:04 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:22:04 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:22:04 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:22:04 user nova-compute[74658]:     </memballoon>
Nov 16 15:22:04 user nova-compute[74658]:   </devices>
Nov 16 15:22:04 user nova-compute[74658]: </domain>
Nov 16 15:22:04 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-195038505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-195038505',id=18,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUYALn+Qe4bwBouHMM172AwnuDCo8Hub97tHOoN+sL0yYCQQKPRlPEZKYjt7+tYhGGAM1S+tJ0NSYwnH68UBRN5GsdSVFRHkmY5xPtQI9glZ3saVVE/aVmRO8U+qZ4/ZA==',key_name='tempest-keypair-498949403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='246582f6f0c74a049de9e4d91f284c9b',ramdisk_id='',reservation_id='r-jlw5bbtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-281283563',owner_user_name='tempest-TaggedAttachmentsTest-281283563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:22:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa52214955ba4f01a25e5f74699f82b4',uuid=6aa0fa12-4970-442d-ae49-36266e774d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converting VIF {"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:76:63,bridge_name='br-int',has_traffic_filtering=True,id=7835b05b-5b80-4071-9f12-34a63399f7b8,network=Network(9773b97c-d7cf-4ef1-a989-d2e2fde157e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7835b05b-5b') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG os_vif [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:76:63,bridge_name='br-int',has_traffic_filtering=True,id=7835b05b-5b80-4071-9f12-34a63399f7b8,network=Network(9773b97c-d7cf-4ef1-a989-d2e2fde157e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7835b05b-5b') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9953fdd-2598-5d5e-baf3-a34e1a973e1e', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7835b05b-5b, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7835b05b-5b, col_values=(('qos', UUID('06c2dcc7-7d3d-49a5-be91-0e32dd557d33')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7835b05b-5b, col_values=(('external_ids', {'iface-id': '7835b05b-5b80-4071-9f12-34a63399f7b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:76:63', 'vm-uuid': '6aa0fa12-4970-442d-ae49-36266e774d68'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Creating config drive at /opt/stack/data/nova/instances/ddbd0152-96d0-4c58-bda2-a0fe2c905c28/disk.config
Nov 16 15:22:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ddbd0152-96d0-4c58-bda2-a0fe2c905c28/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdptr4eee {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:04 user nova-compute[74658]: INFO os_vif [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:76:63,bridge_name='br-int',has_traffic_filtering=True,id=7835b05b-5b80-4071-9f12-34a63399f7b8,network=Network(9773b97c-d7cf-4ef1-a989-d2e2fde157e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7835b05b-5b')
Nov 16 15:22:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ddbd0152-96d0-4c58-bda2-a0fe2c905c28/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdptr4eee" returned: 0 in 0.055s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] No BDM found with device name hda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] No VIF found with MAC fa:16:3e:85:76:63, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:22:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Using config drive
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.network.neutron [req-2df24924-f4cc-4993-95e2-6adeb9e08b5a req-1ad26edc-bd9e-4485-b293-240eed126570 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updated VIF entry in instance network info cache for port 7835b05b-5b80-4071-9f12-34a63399f7b8. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG nova.network.neutron [req-2df24924-f4cc-4993-95e2-6adeb9e08b5a req-1ad26edc-bd9e-4485-b293-240eed126570 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updating instance_info_cache with network_info: [{"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:22:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2df24924-f4cc-4993-95e2-6adeb9e08b5a req-1ad26edc-bd9e-4485-b293-240eed126570 service nova] Releasing lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:22:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Creating config drive at /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk.config
Nov 16 15:22:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_mqnk106 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_mqnk106" returned: 0 in 0.050s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-cb8913af-1b06-4267-baac-3ff7833d7f9c req-3b7c3087-ee8b-4919-833f-10c98bb7babf service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cb8913af-1b06-4267-baac-3ff7833d7f9c req-3b7c3087-ee8b-4919-833f-10c98bb7babf service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cb8913af-1b06-4267-baac-3ff7833d7f9c req-3b7c3087-ee8b-4919-833f-10c98bb7babf service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cb8913af-1b06-4267-baac-3ff7833d7f9c req-3b7c3087-ee8b-4919-833f-10c98bb7babf service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-cb8913af-1b06-4267-baac-3ff7833d7f9c req-3b7c3087-ee8b-4919-833f-10c98bb7babf service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:07 user nova-compute[74658]: WARNING nova.compute.manager [req-cb8913af-1b06-4267-baac-3ff7833d7f9c req-3b7c3087-ee8b-4919-833f-10c98bb7babf service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 for instance with vm_state building and task_state spawning.
Nov 16 15:22:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-97d79481-fe67-40ae-80c3-c20965bb6265 req-3f0edcef-38e7-43e1-a425-5af00d73a99e service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-593b4c31-e20e-46a4-ae7f-33b951762c4a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-97d79481-fe67-40ae-80c3-c20965bb6265 req-3f0edcef-38e7-43e1-a425-5af00d73a99e service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-97d79481-fe67-40ae-80c3-c20965bb6265 req-3f0edcef-38e7-43e1-a425-5af00d73a99e service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-97d79481-fe67-40ae-80c3-c20965bb6265 req-3f0edcef-38e7-43e1-a425-5af00d73a99e service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-97d79481-fe67-40ae-80c3-c20965bb6265 req-3f0edcef-38e7-43e1-a425-5af00d73a99e service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-593b4c31-e20e-46a4-ae7f-33b951762c4a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:08 user nova-compute[74658]: WARNING nova.compute.manager [req-97d79481-fe67-40ae-80c3-c20965bb6265 req-3f0edcef-38e7-43e1-a425-5af00d73a99e service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-593b4c31-e20e-46a4-ae7f-33b951762c4a for instance with vm_state building and task_state spawning.
Nov 16 15:22:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:09 user nova-compute[74658]: WARNING nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 for instance with vm_state building and task_state spawning.
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:09 user nova-compute[74658]: WARNING nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received unexpected event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 for instance with vm_state building and task_state spawning.
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:09 user nova-compute[74658]: WARNING nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received unexpected event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 for instance with vm_state building and task_state spawning.
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:09 user nova-compute[74658]: WARNING nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c for instance with vm_state building and task_state spawning.
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:09 user nova-compute[74658]: WARNING nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c for instance with vm_state building and task_state spawning.
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:09 user nova-compute[74658]: WARNING nova.compute.manager [req-fc4d97db-9b3a-464e-9e2d-5c6aa5ac1f85 req-5dfa6ddd-ad79-40ea-acbc-fff85d388262 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb for instance with vm_state building and task_state spawning.
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-593b4c31-e20e-46a4-ae7f-33b951762c4a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-593b4c31-e20e-46a4-ae7f-33b951762c4a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:10 user nova-compute[74658]: WARNING nova.compute.manager [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-593b4c31-e20e-46a4-ae7f-33b951762c4a for instance with vm_state building and task_state spawning.
Nov 16 15:22:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:10 user nova-compute[74658]: WARNING nova.compute.manager [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c for instance with vm_state building and task_state spawning.
Nov 16 15:22:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:10 user nova-compute[74658]: WARNING nova.compute.manager [req-ab67e52e-fee6-41e8-bd74-fc47e29f3946 req-ea4a8226-5525-4c65-b40e-116f38a6890f service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c for instance with vm_state building and task_state spawning.
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:22:11 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Instance spawned successfully.
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:11 user nova-compute[74658]: INFO nova.compute.manager [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Took 9.15 seconds to spawn the instance on the hypervisor.
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:22:11 user nova-compute[74658]: INFO nova.compute.manager [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Took 9.99 seconds to build instance.
Nov 16 15:22:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-416ae11e-2ee4-431c-802e-d2720cee3862 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.094s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-51b19500-20f2-4654-905f-82ac26a47b20 req-3415acb9-d0e5-43f3-adb1-7cb108b3bc27 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-51b19500-20f2-4654-905f-82ac26a47b20 req-3415acb9-d0e5-43f3-adb1-7cb108b3bc27 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-51b19500-20f2-4654-905f-82ac26a47b20 req-3415acb9-d0e5-43f3-adb1-7cb108b3bc27 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-51b19500-20f2-4654-905f-82ac26a47b20 req-3415acb9-d0e5-43f3-adb1-7cb108b3bc27 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-51b19500-20f2-4654-905f-82ac26a47b20 req-3415acb9-d0e5-43f3-adb1-7cb108b3bc27 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:11 user nova-compute[74658]: WARNING nova.compute.manager [req-51b19500-20f2-4654-905f-82ac26a47b20 req-3415acb9-d0e5-43f3-adb1-7cb108b3bc27 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb for instance with vm_state building and task_state spawning.
Nov 16 15:22:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:22:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:22:12 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Instance spawned successfully.
Nov 16 15:22:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:22:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:12 user nova-compute[74658]: INFO nova.compute.manager [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Took 13.84 seconds to spawn the instance on the hypervisor.
Nov 16 15:22:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:22:12 user nova-compute[74658]: INFO nova.compute.manager [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Took 31.12 seconds to build instance.
Nov 16 15:22:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-631a8068-f4f5-4ff0-8dbb-62bd5d5412d6 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.272s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:13 user nova-compute[74658]: WARNING nova.compute.manager [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 for instance with vm_state active and task_state None.
Nov 16 15:22:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:13 user nova-compute[74658]: WARNING nova.compute.manager [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 for instance with vm_state active and task_state None.
Nov 16 15:22:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:13 user nova-compute[74658]: WARNING nova.compute.manager [req-a8143c10-3774-4c11-8711-fc180014ec11 req-6030f3f3-3e07-479d-8fc9-2c0f8b315975 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 for instance with vm_state active and task_state None.
Nov 16 15:22:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-19c79d3e-c537-46ec-9ed0-9a0bc5b8e1a0 req-1a50486c-075d-43d3-a311-8e3209e9f80d service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-19c79d3e-c537-46ec-9ed0-9a0bc5b8e1a0 req-1a50486c-075d-43d3-a311-8e3209e9f80d service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-19c79d3e-c537-46ec-9ed0-9a0bc5b8e1a0 req-1a50486c-075d-43d3-a311-8e3209e9f80d service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-19c79d3e-c537-46ec-9ed0-9a0bc5b8e1a0 req-1a50486c-075d-43d3-a311-8e3209e9f80d service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-19c79d3e-c537-46ec-9ed0-9a0bc5b8e1a0 req-1a50486c-075d-43d3-a311-8e3209e9f80d service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:15 user nova-compute[74658]: WARNING nova.compute.manager [req-19c79d3e-c537-46ec-9ed0-9a0bc5b8e1a0 req-1a50486c-075d-43d3-a311-8e3209e9f80d service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 for instance with vm_state active and task_state None.
Nov 16 15:22:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:22:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:22:24 user nova-compute[74658]: INFO nova.compute.claims [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Claim successful on node user
Nov 16 15:22:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:22:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:22:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG nova.policy [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '273f88233c0341b8a43761f45b3d9c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b1b7e5c218402b9575db3d0cde0396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:22:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Creating image(s)
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "/opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "/opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk 1073741824" returned: 0 in 0.052s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:25 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Successfully created port: ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Cannot resize image /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Ensure instance console log exists: /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Successfully updated port: ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquired lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-5f631645-53c9-4464-8693-86bb0b5924e5 req-8e98aa3f-07d9-4951-b2b7-3da58fda5ea7 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Received event network-changed-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-5f631645-53c9-4464-8693-86bb0b5924e5 req-8e98aa3f-07d9-4951-b2b7-3da58fda5ea7 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Refreshing instance network info cache due to event network-changed-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5f631645-53c9-4464-8693-86bb0b5924e5 req-8e98aa3f-07d9-4951-b2b7-3da58fda5ea7 service nova] Acquiring lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:22:26 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Updating instance_info_cache with network_info: [{"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Releasing lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Instance network_info: |[{"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5f631645-53c9-4464-8693-86bb0b5924e5 req-8e98aa3f-07d9-4951-b2b7-3da58fda5ea7 service nova] Acquired lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.network.neutron [req-5f631645-53c9-4464-8693-86bb0b5924e5 req-8e98aa3f-07d9-4951-b2b7-3da58fda5ea7 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Refreshing network info cache for port ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Start _get_guest_xml network_info=[{"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:22:27 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:22:27 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1678539302',display_name='tempest-VolumesAdminNegativeTest-server-1678539302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1678539302',id=19,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1xTGVdXg/QKOPV1EjYpFjfnQePma3USIAuLeMzqREuyJ/PC1prOpr8tw1rMXP7AeG5Q6E5DOhRAjfYTjDeogagQ8e6JuJes6RgDig75m2ILlV7ivV3JpaQc3oon8FpXg==',key_name='tempest-keypair-1679391218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80b1b7e5c218402b9575db3d0cde0396',ramdisk_id='',reservation_id='r-zica6mwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2132519312',owner_user_name='tempest-VolumesAdminNegativeTest-2132519312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='273f88233c0341b8a43761f45b3d9c82',uuid=bf2fe627-5a1c-44f0-b872-1d4275baac59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converting VIF {"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1e:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab836cbe-d4b9-43bc-bee5-bd37dd08ba40,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab836cbe-d4') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.objects.instance [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lazy-loading 'pci_devices' on Instance uuid bf2fe627-5a1c-44f0-b872-1d4275baac59 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:22:27 user nova-compute[74658]:   <uuid>bf2fe627-5a1c-44f0-b872-1d4275baac59</uuid>
Nov 16 15:22:27 user nova-compute[74658]:   <name>instance-00000013</name>
Nov 16 15:22:27 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:22:27 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:22:27 user nova-compute[74658]:   <metadata>
Nov 16 15:22:27 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:22:27 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:22:27 user nova-compute[74658]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1678539302</nova:name>
Nov 16 15:22:27 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:22:27</nova:creationTime>
Nov 16 15:22:27 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:22:27 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:22:27 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:22:27 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:22:27 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:22:27 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:22:27 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:22:27 user nova-compute[74658]:       <nova:owner>
Nov 16 15:22:27 user nova-compute[74658]:         <nova:user uuid="273f88233c0341b8a43761f45b3d9c82">tempest-VolumesAdminNegativeTest-2132519312-project-member</nova:user>
Nov 16 15:22:27 user nova-compute[74658]:         <nova:project uuid="80b1b7e5c218402b9575db3d0cde0396">tempest-VolumesAdminNegativeTest-2132519312</nova:project>
Nov 16 15:22:27 user nova-compute[74658]:       </nova:owner>
Nov 16 15:22:27 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:22:27 user nova-compute[74658]:       <nova:ports>
Nov 16 15:22:27 user nova-compute[74658]:         <nova:port uuid="ab836cbe-d4b9-43bc-bee5-bd37dd08ba40">
Nov 16 15:22:27 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 15:22:27 user nova-compute[74658]:         </nova:port>
Nov 16 15:22:27 user nova-compute[74658]:       </nova:ports>
Nov 16 15:22:27 user nova-compute[74658]:     </nova:instance>
Nov 16 15:22:27 user nova-compute[74658]:   </metadata>
Nov 16 15:22:27 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:22:27 user nova-compute[74658]:     <system>
Nov 16 15:22:27 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:22:27 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:22:27 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:22:27 user nova-compute[74658]:       <entry name="serial">bf2fe627-5a1c-44f0-b872-1d4275baac59</entry>
Nov 16 15:22:27 user nova-compute[74658]:       <entry name="uuid">bf2fe627-5a1c-44f0-b872-1d4275baac59</entry>
Nov 16 15:22:27 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:22:27 user nova-compute[74658]:     </system>
Nov 16 15:22:27 user nova-compute[74658]:   </sysinfo>
Nov 16 15:22:27 user nova-compute[74658]:   <os>
Nov 16 15:22:27 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:22:27 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:22:27 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:22:27 user nova-compute[74658]:   </os>
Nov 16 15:22:27 user nova-compute[74658]:   <features>
Nov 16 15:22:27 user nova-compute[74658]:     <acpi/>
Nov 16 15:22:27 user nova-compute[74658]:     <apic/>
Nov 16 15:22:27 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:22:27 user nova-compute[74658]:   </features>
Nov 16 15:22:27 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:22:27 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:22:27 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:22:27 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:22:27 user nova-compute[74658]:   </clock>
Nov 16 15:22:27 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:22:27 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:22:27 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:22:27 user nova-compute[74658]:   </cpu>
Nov 16 15:22:27 user nova-compute[74658]:   <devices>
Nov 16 15:22:27 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:22:27 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:22:27 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk"/>
Nov 16 15:22:27 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:22:27 user nova-compute[74658]:     </disk>
Nov 16 15:22:27 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:22:27 user nova-compute[74658]:       <mac address="fa:16:3e:0b:1e:bd"/>
Nov 16 15:22:27 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:27 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:22:27 user nova-compute[74658]:       <target dev="tapab836cbe-d4"/>
Nov 16 15:22:27 user nova-compute[74658]:     </interface>
Nov 16 15:22:27 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:22:27 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/console.log" append="off"/>
Nov 16 15:22:27 user nova-compute[74658]:     </serial>
Nov 16 15:22:27 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:22:27 user nova-compute[74658]:     <video>
Nov 16 15:22:27 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:22:27 user nova-compute[74658]:     </video>
Nov 16 15:22:27 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:22:27 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:22:27 user nova-compute[74658]:     </rng>
Nov 16 15:22:27 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:22:27 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:22:27 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:22:27 user nova-compute[74658]:     </memballoon>
Nov 16 15:22:27 user nova-compute[74658]:   </devices>
Nov 16 15:22:27 user nova-compute[74658]: </domain>
Nov 16 15:22:27 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1678539302',display_name='tempest-VolumesAdminNegativeTest-server-1678539302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1678539302',id=19,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1xTGVdXg/QKOPV1EjYpFjfnQePma3USIAuLeMzqREuyJ/PC1prOpr8tw1rMXP7AeG5Q6E5DOhRAjfYTjDeogagQ8e6JuJes6RgDig75m2ILlV7ivV3JpaQc3oon8FpXg==',key_name='tempest-keypair-1679391218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80b1b7e5c218402b9575db3d0cde0396',ramdisk_id='',reservation_id='r-zica6mwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2132519312',owner_user_name='tempest-VolumesAdminNegativeTest-2132519312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='273f88233c0341b8a43761f45b3d9c82',uuid=bf2fe627-5a1c-44f0-b872-1d4275baac59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converting VIF {"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1e:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab836cbe-d4b9-43bc-bee5-bd37dd08ba40,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab836cbe-d4') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG os_vif [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1e:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab836cbe-d4b9-43bc-bee5-bd37dd08ba40,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab836cbe-d4') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1470da58-8a1d-581d-a68b-702daa525efb', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab836cbe-d4, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab836cbe-d4, col_values=(('qos', UUID('5cd91173-c0b3-463a-821f-d0869411482b')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab836cbe-d4, col_values=(('external_ids', {'iface-id': 'ab836cbe-d4b9-43bc-bee5-bd37dd08ba40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:1e:bd', 'vm-uuid': 'bf2fe627-5a1c-44f0-b872-1d4275baac59'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:27 user nova-compute[74658]: INFO os_vif [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1e:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab836cbe-d4b9-43bc-bee5-bd37dd08ba40,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab836cbe-d4')
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] No VIF found with MAC fa:16:3e:0b:1e:bd, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.network.neutron [req-5f631645-53c9-4464-8693-86bb0b5924e5 req-8e98aa3f-07d9-4951-b2b7-3da58fda5ea7 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Updated VIF entry in instance network info cache for port ab836cbe-d4b9-43bc-bee5-bd37dd08ba40. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG nova.network.neutron [req-5f631645-53c9-4464-8693-86bb0b5924e5 req-8e98aa3f-07d9-4951-b2b7-3da58fda5ea7 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Updating instance_info_cache with network_info: [{"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:22:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5f631645-53c9-4464-8693-86bb0b5924e5 req-8e98aa3f-07d9-4951-b2b7-3da58fda5ea7 service nova] Releasing lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:22:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-2191036a-3406-41f4-8ccc-0d4f64107ffe req-e76a82b6-48b2-4e49-a331-0470b4bcd665 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Received event network-vif-plugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2191036a-3406-41f4-8ccc-0d4f64107ffe req-e76a82b6-48b2-4e49-a331-0470b4bcd665 service nova] Acquiring lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2191036a-3406-41f4-8ccc-0d4f64107ffe req-e76a82b6-48b2-4e49-a331-0470b4bcd665 service nova] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2191036a-3406-41f4-8ccc-0d4f64107ffe req-e76a82b6-48b2-4e49-a331-0470b4bcd665 service nova] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-2191036a-3406-41f4-8ccc-0d4f64107ffe req-e76a82b6-48b2-4e49-a331-0470b4bcd665 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] No waiting events found dispatching network-vif-plugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:29 user nova-compute[74658]: WARNING nova.compute.manager [req-2191036a-3406-41f4-8ccc-0d4f64107ffe req-e76a82b6-48b2-4e49-a331-0470b4bcd665 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Received unexpected event network-vif-plugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 for instance with vm_state building and task_state spawning.
Nov 16 15:22:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-24ef9666-286a-45a2-a57c-b65900751e1f req-0d6d11cf-9525-4f6c-8f28-822b86300e37 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Received event network-vif-plugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24ef9666-286a-45a2-a57c-b65900751e1f req-0d6d11cf-9525-4f6c-8f28-822b86300e37 service nova] Acquiring lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24ef9666-286a-45a2-a57c-b65900751e1f req-0d6d11cf-9525-4f6c-8f28-822b86300e37 service nova] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24ef9666-286a-45a2-a57c-b65900751e1f req-0d6d11cf-9525-4f6c-8f28-822b86300e37 service nova] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-24ef9666-286a-45a2-a57c-b65900751e1f req-0d6d11cf-9525-4f6c-8f28-822b86300e37 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] No waiting events found dispatching network-vif-plugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:31 user nova-compute[74658]: WARNING nova.compute.manager [req-24ef9666-286a-45a2-a57c-b65900751e1f req-0d6d11cf-9525-4f6c-8f28-822b86300e37 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Received unexpected event network-vif-plugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 for instance with vm_state building and task_state spawning.
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:22:31 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Instance spawned successfully.
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:22:31 user nova-compute[74658]: INFO nova.compute.manager [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 16 15:22:31 user nova-compute[74658]: DEBUG nova.compute.manager [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:22:31 user nova-compute[74658]: INFO nova.compute.manager [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Took 6.69 seconds to build instance.
Nov 16 15:22:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f9f9c40d-bff7-49e2-8cc1-e4750120402d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.795s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-3621a6b4-50d3-4bfb-97b8-e17d91ce7468 req-6c729732-d8fe-4b8b-9b28-46212333db70 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-changed-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-3621a6b4-50d3-4bfb-97b8-e17d91ce7468 req-6c729732-d8fe-4b8b-9b28-46212333db70 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Refreshing instance network info cache due to event network-changed-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:22:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3621a6b4-50d3-4bfb-97b8-e17d91ce7468 req-6c729732-d8fe-4b8b-9b28-46212333db70 service nova] Acquiring lock "refresh_cache-e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:22:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3621a6b4-50d3-4bfb-97b8-e17d91ce7468 req-6c729732-d8fe-4b8b-9b28-46212333db70 service nova] Acquired lock "refresh_cache-e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:22:39 user nova-compute[74658]: DEBUG nova.network.neutron [req-3621a6b4-50d3-4bfb-97b8-e17d91ce7468 req-6c729732-d8fe-4b8b-9b28-46212333db70 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Refreshing network info cache for port 7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:22:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG nova.objects.instance [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'flavor' on Instance uuid e1a0ba07-9784-4984-a0a2-4dd1d55cb53d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:40 user nova-compute[74658]: INFO nova.compute.manager [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Attaching volume e52739fd-550d-422e-85ea-ac2c985424d0 to /dev/vdb
Nov 16 15:22:40 user nova-compute[74658]: DEBUG os_brick.utils [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1ed54c-f2d1-4738-aee0-6e399a3983bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea828f4-c3f3-41a7-a03a-f5775ff9620b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0e2c7-c695-4218-8fae-c97983ebedc9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d927ea3-0491-4711-837b-121f4d1d3fc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:22:40 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5a9ffb-a0ba-458b-a9af-dcddd55644c6]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG os_brick.utils [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Updating existing volume attachment record: 315a0b10-4655-483a-bbfd-85933cf3f4f6 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG nova.network.neutron [req-3621a6b4-50d3-4bfb-97b8-e17d91ce7468 req-6c729732-d8fe-4b8b-9b28-46212333db70 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Updated VIF entry in instance network info cache for port 7cd5fe13-ad8c-4d41-9e1e-09d269fd8685. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG nova.network.neutron [req-3621a6b4-50d3-4bfb-97b8-e17d91ce7468 req-6c729732-d8fe-4b8b-9b28-46212333db70 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Updating instance_info_cache with network_info: [{"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:22:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3621a6b4-50d3-4bfb-97b8-e17d91ce7468 req-6c729732-d8fe-4b8b-9b28-46212333db70 service nova] Releasing lock "refresh_cache-e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:22:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Acquiring lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Acquiring lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:41 user nova-compute[74658]: INFO nova.compute.manager [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Terminating instance
Nov 16 15:22:41 user nova-compute[74658]: DEBUG nova.compute.manager [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:22:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-8c0b1dfe-73ee-44a1-aaad-c067160ff94c req-0395a4d0-906c-4cd2-9ced-142ff4c4413a service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Received event network-vif-unplugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8c0b1dfe-73ee-44a1-aaad-c067160ff94c req-0395a4d0-906c-4cd2-9ced-142ff4c4413a service nova] Acquiring lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8c0b1dfe-73ee-44a1-aaad-c067160ff94c req-0395a4d0-906c-4cd2-9ced-142ff4c4413a service nova] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8c0b1dfe-73ee-44a1-aaad-c067160ff94c req-0395a4d0-906c-4cd2-9ced-142ff4c4413a service nova] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-8c0b1dfe-73ee-44a1-aaad-c067160ff94c req-0395a4d0-906c-4cd2-9ced-142ff4c4413a service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] No waiting events found dispatching network-vif-unplugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-8c0b1dfe-73ee-44a1-aaad-c067160ff94c req-0395a4d0-906c-4cd2-9ced-142ff4c4413a service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Received event network-vif-unplugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:22:42 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Instance destroyed successfully.
Nov 16 15:22:42 user nova-compute[74658]: DEBUG nova.objects.instance [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lazy-loading 'resources' on Instance uuid 020c2d27-cb9b-4624-acea-e3e4446ccbfe {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1385212368',display_name='tempest-VolumesActionsTest-instance-1385212368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1385212368',id=13,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:20:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bd769ec72d94d5aa1a2e5f7274b985c',ramdisk_id='',reservation_id='r-92mh2ogj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1040536036',owner_user_name='tempest-VolumesActionsTest-1040536036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:20:53Z,user_data=None,user_id='0c0dab3698614bc6928b9b24a3d8be5f',uuid=020c2d27-cb9b-4624-acea-e3e4446ccbfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "address": "fa:16:3e:48:11:73", "network": {"id": "fd45699b-227b-4ade-a66e-6bf1f5c6f371", "bridge": "br-int", "label": "tempest-VolumesActionsTest-692037496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bd769ec72d94d5aa1a2e5f7274b985c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4bb213-69", "ovs_interfaceid": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Converting VIF {"id": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "address": "fa:16:3e:48:11:73", "network": {"id": "fd45699b-227b-4ade-a66e-6bf1f5c6f371", "bridge": "br-int", "label": "tempest-VolumesActionsTest-692037496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bd769ec72d94d5aa1a2e5f7274b985c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4bb213-69", "ovs_interfaceid": "ad4bb213-69cc-428a-ba46-504e6ba69ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:11:73,bridge_name='br-int',has_traffic_filtering=True,id=ad4bb213-69cc-428a-ba46-504e6ba69ca0,network=Network(fd45699b-227b-4ade-a66e-6bf1f5c6f371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4bb213-69') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG os_vif [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:11:73,bridge_name='br-int',has_traffic_filtering=True,id=ad4bb213-69cc-428a-ba46-504e6ba69ca0,network=Network(fd45699b-227b-4ade-a66e-6bf1f5c6f371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4bb213-69') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad4bb213-69, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40eda682-44b0-4751-98d8-839046ea15ea) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:42 user nova-compute[74658]: INFO os_vif [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:11:73,bridge_name='br-int',has_traffic_filtering=True,id=ad4bb213-69cc-428a-ba46-504e6ba69ca0,network=Network(fd45699b-227b-4ade-a66e-6bf1f5c6f371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4bb213-69')
Nov 16 15:22:42 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Deleting instance files /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe_del
Nov 16 15:22:42 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Deletion of /opt/stack/data/nova/instances/020c2d27-cb9b-4624-acea-e3e4446ccbfe_del complete
Nov 16 15:22:42 user nova-compute[74658]: INFO nova.compute.manager [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 16 15:22:42 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:22:42 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:22:42 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Took 0.49 seconds to deallocate network for instance.
Nov 16 15:22:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:43 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:22:43 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:22:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:43 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Deleted allocations for instance 020c2d27-cb9b-4624-acea-e3e4446ccbfe
Nov 16 15:22:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-62911556-9b9a-49d4-810f-e0a69a507949 tempest-VolumesActionsTest-1040536036 tempest-VolumesActionsTest-1040536036-project-member] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.073s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-b67c699a-9e6f-417c-a63b-e3745b2fe16a req-20acfb6b-d9f1-4485-b8d9-dfdccdcb6aa4 service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Received event network-vif-plugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b67c699a-9e6f-417c-a63b-e3745b2fe16a req-20acfb6b-d9f1-4485-b8d9-dfdccdcb6aa4 service nova] Acquiring lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b67c699a-9e6f-417c-a63b-e3745b2fe16a req-20acfb6b-d9f1-4485-b8d9-dfdccdcb6aa4 service nova] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b67c699a-9e6f-417c-a63b-e3745b2fe16a req-20acfb6b-d9f1-4485-b8d9-dfdccdcb6aa4 service nova] Lock "020c2d27-cb9b-4624-acea-e3e4446ccbfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-b67c699a-9e6f-417c-a63b-e3745b2fe16a req-20acfb6b-d9f1-4485-b8d9-dfdccdcb6aa4 service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] No waiting events found dispatching network-vif-plugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:44 user nova-compute[74658]: WARNING nova.compute.manager [req-b67c699a-9e6f-417c-a63b-e3745b2fe16a req-20acfb6b-d9f1-4485-b8d9-dfdccdcb6aa4 service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Received unexpected event network-vif-plugged-ad4bb213-69cc-428a-ba46-504e6ba69ca0 for instance with vm_state deleted and task_state None.
Nov 16 15:22:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-b67c699a-9e6f-417c-a63b-e3745b2fe16a req-20acfb6b-d9f1-4485-b8d9-dfdccdcb6aa4 service nova] [instance: 020c2d27-cb9b-4624-acea-e3e4446ccbfe] Received event network-vif-deleted-ad4bb213-69cc-428a-ba46-504e6ba69ca0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALUJtqNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:22:45 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:22:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:22:45 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:22:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:22:45 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:22:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[505c48b7-6a17-4f36-856a-970613663722]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:22:45 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4129202-d9ca-4c6e-a3e0-e7047077c859]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0] added
Nov 16 15:22:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1500047-f5a5-4808-8ea9-a4835a331f9f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eec9844-f72b-4045-9047-d9765219bbc0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALUJtqNV {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALUJtqNV" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[122833be-f305-4a56-9d8d-8f1fa9335634]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ALUJtqNV'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.118s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de1d309-62b4-43d5-b23f-7bc14fd152a2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.084s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c16f227-2abc-4be5-baa7-16a72ed46e73]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eccf64-07c0-4125-86fa-63652a888e12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260]
Nov 16 15:22:46 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260] successful.
Nov 16 15:22:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cfc446-de68-496c-be29-5784238775d4]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[40261ffc-6ffb-4973-89bf-4141241d73d1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:22:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.563s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47ccc84-4689-4793-a24a-69e4df566a02]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:22:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:22:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALUJtqNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:22:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.603s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:22:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== connect_volume: return (1605ms) {'type': 'block', 'scsi_wwn': '26139613765353532', 'path': '/dev/sdg'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:22:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139613765353532', 'path': '/dev/sdg'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:22:47 user nova-compute[74658]: DEBUG nova.objects.instance [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'flavor' on Instance uuid e1a0ba07-9784-4984-a0a2-4dd1d55cb53d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:22:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:22:47 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:22:47 user nova-compute[74658]:   <source dev="/dev/sdg"/>
Nov 16 15:22:47 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:22:47 user nova-compute[74658]:   <serial>e52739fd-550d-422e-85ea-ac2c985424d0</serial>
Nov 16 15:22:47 user nova-compute[74658]: </disk>
Nov 16 15:22:47 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:22:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:22:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:22:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No VIF found with MAC fa:16:3e:67:46:cc, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:22:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d27a7197-19a0-4efb-8c14-2844009e391c tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.671s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:49 user nova-compute[74658]: INFO nova.compute.manager [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Rebuilding instance
Nov 16 15:22:49 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:22:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-54fcacb3-c7da-41ec-adf8-0e2cda97723e req-309453b1-8074-49af-a285-05dc1b9eb42c service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-unplugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-54fcacb3-c7da-41ec-adf8-0e2cda97723e req-309453b1-8074-49af-a285-05dc1b9eb42c service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-54fcacb3-c7da-41ec-adf8-0e2cda97723e req-309453b1-8074-49af-a285-05dc1b9eb42c service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-54fcacb3-c7da-41ec-adf8-0e2cda97723e req-309453b1-8074-49af-a285-05dc1b9eb42c service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-54fcacb3-c7da-41ec-adf8-0e2cda97723e req-309453b1-8074-49af-a285-05dc1b9eb42c service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-unplugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:50 user nova-compute[74658]: WARNING nova.compute.manager [req-54fcacb3-c7da-41ec-adf8-0e2cda97723e req-309453b1-8074-49af-a285-05dc1b9eb42c service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received unexpected event network-vif-unplugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with vm_state active and task_state rebuilding.
Nov 16 15:22:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:50 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Instance destroyed successfully.
Nov 16 15:22:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:50 user nova-compute[74658]: INFO nova.compute.manager [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Detaching volume e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:22:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:50 user nova-compute[74658]: INFO nova.virt.block_device [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Attempting to driver detach volume e52739fd-550d-422e-85ea-ac2c985424d0 from mountpoint /dev/vdb
Nov 16 15:22:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Attempting to detach device vdb from instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:22:50 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:22:50 user nova-compute[74658]:   <source dev="/dev/sdg"/>
Nov 16 15:22:50 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:22:50 user nova-compute[74658]:   <serial>e52739fd-550d-422e-85ea-ac2c985424d0</serial>
Nov 16 15:22:50 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:22:50 user nova-compute[74658]: </disk>
Nov 16 15:22:50 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:22:50 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully detached device vdb from instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d from the persistent domain config.
Nov 16 15:22:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALUJtqNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:22:50 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 15:22:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:22:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f606ed6d-69fe-49fc-8806-aa4dc617ebc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:22:51 user nova-compute[74658]: No targets found.
Nov 16 15:22:51 user nova-compute[74658]: iSNS:
Nov 16 15:22:51 user nova-compute[74658]: No targets found.
Nov 16 15:22:51 user nova-compute[74658]: STATIC:
Nov 16 15:22:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458
Nov 16 15:22:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918
Nov 16 15:22:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:22:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:22:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00
Nov 16 15:22:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:51 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:22:51 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:51 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:51 user nova-compute[74658]: FIRMWARE:
Nov 16 15:22:51 user nova-compute[74658]: No targets found.
Nov 16 15:22:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:22:51 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:22:51 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9402dc-3762-4680-b1dc-8b8aaf196e9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e53fcf-00b3-4506-aac7-624a9302732d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:51 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:51 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:51 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:51 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:51 user nova-compute[74658]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:22:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:51 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:51 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:51 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:51 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:51 user nova-compute[74658]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:22:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710142950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0'): ({'sdg'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Removing single pathed devices sdg {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0fdc3a-12cf-466a-9917-a93867712646]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dead91-9481-438b-a161-0e6919ace03f]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flushing IO for device /dev/sdg {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e679e9bd-cdbd-4929-9f3c-ffcc2d8347c4]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95c9bec-f737-44c6-a37e-2e3cec725f81]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] SCSI volumes sdg have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace560ed-11ba-4c16-9f48-478482cbce19]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5fa7b4-9aec-4329-aadd-077eee0f4ae9]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260]
Nov 16 15:22:51 user nova-compute[74658]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260] successful.
Nov 16 15:22:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[23643b50-c65d-49ee-9fbc-8070c8634130]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== disconnect_volume: return (445ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:22:51 user nova-compute[74658]: INFO nova.compute.manager [None req-1ea9519f-6011-46ba-afa9-d0e93d3efeed tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Unrescuing
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1ea9519f-6011-46ba-afa9-d0e93d3efeed tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1ea9519f-6011-46ba-afa9-d0e93d3efeed tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquired lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:22:51 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1ea9519f-6011-46ba-afa9-d0e93d3efeed tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1ea9519f-6011-46ba-afa9-d0e93d3efeed tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updating instance_info_cache with network_info: [{"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1ea9519f-6011-46ba-afa9-d0e93d3efeed tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Releasing lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.objects.instance [None req-1ea9519f-6011-46ba-afa9-d0e93d3efeed tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'flavor' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:52 user nova-compute[74658]: WARNING nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received unexpected event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with vm_state active and task_state rebuilding.
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:52 user nova-compute[74658]: WARNING nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received unexpected event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with vm_state active and task_state rebuilding.
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:52 user nova-compute[74658]: WARNING nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received unexpected event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with vm_state active and task_state rebuilding.
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-unplugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-unplugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:52 user nova-compute[74658]: WARNING nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received unexpected event network-vif-unplugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with vm_state active and task_state rebuilding.
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:52 user nova-compute[74658]: WARNING nova.compute.manager [req-6affe6a8-9889-461a-a082-e88fa0c5a481 req-1763f23e-1182-46ab-ab4d-d7a77fe282bb service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received unexpected event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with vm_state active and task_state rebuilding.
Nov 16 15:22:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Instance destroyed successfully.
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-973719147',display_name='tempest-ServerActionsTestOtherA-server-690127439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-973719147',id=14,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl++RKbB4aUMtrYmCOPdauQa/gpN9opiKUp/X+UapEvp1+7Y6F8dw6oyEwiFoEntT82tpQ3YHK6HAURo3UVwXD4GvU0Ji0v1dRcPaNdtl8esG6M51w55UWC2mDAZTpGjw==',key_name='tempest-keypair-851894490',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:20:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-kms34bsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=e1a0ba07-9784-4984-a0a2-4dd1d55cb53d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_vif [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cd5fe13-ad, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2139beeb-4c6a-499e-b89c-e95ce36060a0) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:52 user nova-compute[74658]: INFO os_vif [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad')
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALUJtqNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:22:52 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d4a4a7-7599-4522-82fa-63aaf1088b1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:22:52 user nova-compute[74658]: No targets found.
Nov 16 15:22:52 user nova-compute[74658]: iSNS:
Nov 16 15:22:52 user nova-compute[74658]: No targets found.
Nov 16 15:22:52 user nova-compute[74658]: STATIC:
Nov 16 15:22:52 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458
Nov 16 15:22:52 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:52 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:52 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918
Nov 16 15:22:52 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:52 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:52 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:22:52 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:52 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:52 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:22:52 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:52 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:52 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00
Nov 16 15:22:52 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:52 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:52 user nova-compute[74658]: FIRMWARE:
Nov 16 15:22:52 user nova-compute[74658]: No targets found.
Nov 16 15:22:52 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:22:52 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:22:52 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92df493-2995-4422-a7e1-76a8c0fee609]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.065s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeda1ee-2343-45cd-8086-08959e6d2ac8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:52 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:52 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:52 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:52 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:52 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:52 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:52 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:52 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:52 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:52 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07101268c0>, {}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Disconnecting from: [] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.125s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== disconnect_volume: return (127ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:22:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Deleting instance files /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d_del
Nov 16 15:22:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Deletion of /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d_del complete
Nov 16 15:22:52 user nova-compute[74658]: INFO nova.virt.block_device [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Booting with volume e52739fd-550d-422e-85ea-ac2c985424d0 at /dev/vdb
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.utils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[993e3d71-ec63-476d-8f02-81ef6766b3d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e68db2-b536-465b-9110-48f52658140c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c145b9-f663-4778-b8de-7eebcc78f864]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[49682d06-d8dc-4856-8595-062c00df0c83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:22:52 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:22:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cbae58-89b5-4389-89c2-e60c276e4bed]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG os_brick.utils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:22:52 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Updating existing volume attachment record: da379da1-1818-4657-b236-86899e1ae508 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:22:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Instance destroyed successfully.
Nov 16 15:22:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-unplugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-unplugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:54 user nova-compute[74658]: WARNING nova.compute.manager [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received unexpected event network-vif-unplugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:22:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-changed-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Refreshing instance network info cache due to event network-changed-a370fa54-9887-42af-b8e5-ab80c536cccd. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Acquiring lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Acquired lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Refreshing network info cache for port a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updated VIF entry in instance network info cache for port a370fa54-9887-42af-b8e5-ab80c536cccd. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updating instance_info_cache with network_info: [{"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Releasing lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-changed-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Refreshing instance network info cache due to event network-changed-a370fa54-9887-42af-b8e5-ab80c536cccd. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Acquiring lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Acquired lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Refreshing network info cache for port a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:22:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:55 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:22:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updated VIF entry in instance network info cache for port a370fa54-9887-42af-b8e5-ab80c536cccd. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:22:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updating instance_info_cache with network_info: [{"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:22:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Releasing lock "refresh_cache-e06fcb99-9271-48da-ac95-3998d45e6ccb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:22:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:55 user nova-compute[74658]: WARNING nova.compute.manager [req-0752e1d3-f2d7-4aa6-b063-14310a380b5c req-a6fd2bd8-6d83-46cf-ae26-2b84ff044f80 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received unexpected event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:56 user nova-compute[74658]: WARNING nova.compute.manager [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received unexpected event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:22:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:56 user nova-compute[74658]: WARNING nova.compute.manager [req-e5cbece0-9eeb-4fde-a6a3-19c52375a6a8 req-f2cb278d-5906-4062-929f-39f0a7c521d0 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received unexpected event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1ea9519f-6011-46ba-afa9-d0e93d3efeed tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Port 6abed81e-257d-4d47-a1b8-586c040fdc92 binding to destination host user is already ACTIVE {{(pid=74658) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquired lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:22:56 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating instance_info_cache with network_info: [{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Releasing lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Creating tmpfile /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/tmpo7wju8st to verify with other compute node that the instance is on the same shared storage. {{(pid=74658) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG nova.compute.manager [req-3b328752-bc3d-4208-bc36-5c9cca9e655c req-b1ed7be6-a352-479b-84ba-a0223081f3c2 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-unplugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3b328752-bc3d-4208-bc36-5c9cca9e655c req-b1ed7be6-a352-479b-84ba-a0223081f3c2 service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3b328752-bc3d-4208-bc36-5c9cca9e655c req-b1ed7be6-a352-479b-84ba-a0223081f3c2 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3b328752-bc3d-4208-bc36-5c9cca9e655c req-b1ed7be6-a352-479b-84ba-a0223081f3c2 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG nova.compute.manager [req-3b328752-bc3d-4208-bc36-5c9cca9e655c req-b1ed7be6-a352-479b-84ba-a0223081f3c2 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-unplugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:57 user nova-compute[74658]: WARNING nova.compute.manager [req-3b328752-bc3d-4208-bc36-5c9cca9e655c req-b1ed7be6-a352-479b-84ba-a0223081f3c2 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received unexpected event network-vif-unplugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with vm_state resized and task_state resize_reverting.
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance destroyed successfully.
Nov 16 15:22:58 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lazy-loading 'resources' on Instance uuid 51f00d67-ae3d-4d1b-a721-280bae2e9caf {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1901009930',display_name='tempest-ServerActionsTestOtherB-server-1901009930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1901009930',id=5,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfYsAQlC3nkxAyuTL+KN50dEAunY5gw1KQEIPq+iR4mJ4asJBSmjta4eGNIIDBn+5Mv+AkdxZhEfTWggAEXb2LpORaOL7hjybIPHi4K1ldg1rK7G6KYvZmZ7N35zLKD+g==',key_name='tempest-keypair-983162783',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1e465eeac8f4bc5b11c0a6e3a7bbc61',ramdisk_id='',reservation_id='r-gupt4lp1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-662756880',owner_user_name='tempest-ServerActionsTestOtherB-662756880-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aa837a8e0f14644a3b6b0d3904213f2',uuid=51f00d67-ae3d-4d1b-a721-280bae2e9caf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converting VIF {"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_vif [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6abed81e-25, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7e445e5-0553-4bbc-b593-88bf576e8f8b) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:22:58 user nova-compute[74658]: INFO os_vif [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25')
Nov 16 15:22:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZfabDrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:22:58 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4127f1-d2e3-490e-9a47-c6a93756e10e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:22:58 user nova-compute[74658]: No targets found.
Nov 16 15:22:58 user nova-compute[74658]: iSNS:
Nov 16 15:22:58 user nova-compute[74658]: No targets found.
Nov 16 15:22:58 user nova-compute[74658]: STATIC:
Nov 16 15:22:58 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458
Nov 16 15:22:58 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:58 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:58 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918
Nov 16 15:22:58 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:58 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:58 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:22:58 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:58 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:58 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:22:58 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:58 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:58 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00
Nov 16 15:22:58 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:22:58 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:22:58 user nova-compute[74658]: FIRMWARE:
Nov 16 15:22:58 user nova-compute[74658]: No targets found.
Nov 16 15:22:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:22:58 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:22:58 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c50378-ec67-4a20-9f30-b9b13d2d2a22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[963099c9-4141-44c0-9378-17e88d2e2eb9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:58 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:58 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:58 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:58 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:22:58 user nova-compute[74658]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:22:58 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:22:58 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:22:58 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:22:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f071011ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:22:58 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Creating image(s)
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "/opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "/opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ae227a-6a9c-41ec-affb-f5598464b4fd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d092e10-e46f-4303-95d7-b6e0d7dd71b3]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[25588e0b-3c11-4f16-b677-b8517ae6f0e5]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b8a60a-e60f-464f-bd06-7781ff4a13be]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7739e9ab-e8d0-4a55-89f1-86d026a85594]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.207s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35065a0-d726-4572-9970-567a07669763]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]
Nov 16 15:22:58 user nova-compute[74658]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.
Nov 16 15:22:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[810066b9-72cf-4452-9b5b-9283d3cb7944]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] <== disconnect_volume: return (436ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Error from libvirt while getting description of instance-00000005: [Error Code 42] Domain not found: no domain with matching uuid '51f00d67-ae3d-4d1b-a721-280bae2e9caf' (instance-00000005): libvirt.libvirtError: Domain not found: no domain with matching uuid '51f00d67-ae3d-4d1b-a721-280bae2e9caf' (instance-00000005)
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.200s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk 1073741824" returned: 0 in 0.051s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.558s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Cannot resize image /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Ensure instance console log exists: /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Start _get_guest_xml network_info=[{"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'da379da1-1818-4657-b236-86899e1ae508', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALUJtqNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1a0ba07-9784-4984-a0a2-4dd1d55cb53d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e52739fd-550d-422e-85ea-ac2c985424d0', 'serial': 'e52739fd-550d-422e-85ea-ac2c985424d0'}, 'boot_index': None, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:22:59 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:22:59 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7511MB free_disk=25.441776275634766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:59 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 15:22:59 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1a0ba07-9784-4984-a0a2-4dd1d55cb53d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALUJtqNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:22:59 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 15:22:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:22:59 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 15:22:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:22:59 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e66c842-7714-475a-b6ec-e94c7102de72 req-a73ca5be-e544-4889-b5b1-9f9933156119 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e66c842-7714-475a-b6ec-e94c7102de72 req-a73ca5be-e544-4889-b5b1-9f9933156119 service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e66c842-7714-475a-b6ec-e94c7102de72 req-a73ca5be-e544-4889-b5b1-9f9933156119 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e66c842-7714-475a-b6ec-e94c7102de72 req-a73ca5be-e544-4889-b5b1-9f9933156119 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e66c842-7714-475a-b6ec-e94c7102de72 req-a73ca5be-e544-4889-b5b1-9f9933156119 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:22:59 user nova-compute[74658]: WARNING nova.compute.manager [req-9e66c842-7714-475a-b6ec-e94c7102de72 req-a73ca5be-e544-4889-b5b1-9f9933156119 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received unexpected event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with vm_state resized and task_state resize_reverting.
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77ff266-5b9a-41f1-a06f-f34463757943]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:22:59 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Applying migration context for instance 51f00d67-ae3d-4d1b-a721-280bae2e9caf as it has an incoming, in-progress migration f3c2298c-e980-4f50-b9f1-5bd6118c24c8. Migration status is reverting {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 15:22:59 user nova-compute[74658]: INFO nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating resource usage from migration f3c2298c-e980-4f50-b9f1-5bd6118c24c8
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb62c1a4-3c77-446f-ae22-0282bac93a46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0] added
Nov 16 15:22:59 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 03cbebbf-5414-4309-bfc1-ec0a67e09a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e06fcb99-9271-48da-ac95-3998d45e6ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Migration f3c2298c-e980-4f50-b9f1-5bd6118c24c8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 51f00d67-ae3d-4d1b-a721-280bae2e9caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ca6f21ea-8469-4805-9efe-5580a8dcea56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ddbd0152-96d0-4c58-bda2-a0fe2c905c28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6aa0fa12-4970-442d-ae49-36266e774d68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance bf2fe627-5a1c-44f0-b872-1d4275baac59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8d7cf3-0391-493d-8325-0b66f73e0bef]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:22:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[856a366c-47a5-4522-8128-1e120b7a8b31]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALUJtqNV {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALUJtqNV" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ad7972-8451-47a4-92cb-796867b1b744]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ALUJtqNV'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[786ee656-9aad-467e-b5bc-dd50a8c7f67b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec66664-ae38-4560-80d5-97b72270db8d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[15acbc0c-6c03-4167-8279-8d187005c2a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260]
Nov 16 15:23:00 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260] successful.
Nov 16 15:23:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc7faea-6034-4e9a-9079-8a41f723e8a2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d0a538-95cf-4652-8037-0e8e1027267f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8b209b-dbc5-448f-bfab-b6ed23c0806f]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALUJtqNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.812s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.808s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lazy-loading 'migration_context' on Instance uuid 51f00d67-ae3d-4d1b-a721-280bae2e9caf {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.objects.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Object Instance<51f00d67-ae3d-4d1b-a721-280bae2e9caf> lazy-loaded attributes: resources,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:00 user nova-compute[74658]: DEBUG nova.objects.instance [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lazy-loading 'flavor' on Instance uuid ca6f21ea-8469-4805-9efe-5580a8dcea56 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:00 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Ignoring supplied device name: /dev/vdb
Nov 16 15:23:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:01 user nova-compute[74658]: INFO nova.compute.manager [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Attaching volume 6eeab32a-36c2-4d08-82c8-5f70f1921f42 to /dev/vdb
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.610s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG os_brick.utils [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8278f81e-9353-4365-9ab6-0af1624f4180]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26139613765353532', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139613765353532', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5845b86-5355-4b62-a886-ecde9569a16e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-973719147',display_name='tempest-ServerActionsTestOtherA-server-690127439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-973719147',id=14,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl++RKbB4aUMtrYmCOPdauQa/gpN9opiKUp/X+UapEvp1+7Y6F8dw6oyEwiFoEntT82tpQ3YHK6HAURo3UVwXD4GvU0Ji0v1dRcPaNdtl8esG6M51w55UWC2mDAZTpGjw==',key_name='tempest-keypair-851894490',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:20:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-kms34bsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:22:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=e1a0ba07-9784-4984-a0a2-4dd1d55cb53d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:23:01 user nova-compute[74658]:   <uuid>e1a0ba07-9784-4984-a0a2-4dd1d55cb53d</uuid>
Nov 16 15:23:01 user nova-compute[74658]:   <name>instance-0000000e</name>
Nov 16 15:23:01 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:23:01 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:23:01 user nova-compute[74658]:   <metadata>
Nov 16 15:23:01 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:23:01 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:23:01 user nova-compute[74658]:       <nova:name>tempest-ServerActionsTestOtherA-server-690127439</nova:name>
Nov 16 15:23:01 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:22:59</nova:creationTime>
Nov 16 15:23:01 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:23:01 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:23:01 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:23:01 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:23:01 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:23:01 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:23:01 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:23:01 user nova-compute[74658]:       <nova:owner>
Nov 16 15:23:01 user nova-compute[74658]:         <nova:user uuid="d8507e72d5b248cd8a6a8b9bea6733cb">tempest-ServerActionsTestOtherA-1362925052-project-member</nova:user>
Nov 16 15:23:01 user nova-compute[74658]:         <nova:project uuid="6b189fdeea224d4dbdc2923041dc8e75">tempest-ServerActionsTestOtherA-1362925052</nova:project>
Nov 16 15:23:01 user nova-compute[74658]:       </nova:owner>
Nov 16 15:23:01 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:23:01 user nova-compute[74658]:       <nova:ports>
Nov 16 15:23:01 user nova-compute[74658]:         <nova:port uuid="7cd5fe13-ad8c-4d41-9e1e-09d269fd8685">
Nov 16 15:23:01 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 15:23:01 user nova-compute[74658]:         </nova:port>
Nov 16 15:23:01 user nova-compute[74658]:       </nova:ports>
Nov 16 15:23:01 user nova-compute[74658]:     </nova:instance>
Nov 16 15:23:01 user nova-compute[74658]:   </metadata>
Nov 16 15:23:01 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:23:01 user nova-compute[74658]:     <system>
Nov 16 15:23:01 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:23:01 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:23:01 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:23:01 user nova-compute[74658]:       <entry name="serial">e1a0ba07-9784-4984-a0a2-4dd1d55cb53d</entry>
Nov 16 15:23:01 user nova-compute[74658]:       <entry name="uuid">e1a0ba07-9784-4984-a0a2-4dd1d55cb53d</entry>
Nov 16 15:23:01 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:23:01 user nova-compute[74658]:     </system>
Nov 16 15:23:01 user nova-compute[74658]:   </sysinfo>
Nov 16 15:23:01 user nova-compute[74658]:   <os>
Nov 16 15:23:01 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:23:01 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:23:01 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:23:01 user nova-compute[74658]:   </os>
Nov 16 15:23:01 user nova-compute[74658]:   <features>
Nov 16 15:23:01 user nova-compute[74658]:     <acpi/>
Nov 16 15:23:01 user nova-compute[74658]:     <apic/>
Nov 16 15:23:01 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:23:01 user nova-compute[74658]:   </features>
Nov 16 15:23:01 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:23:01 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:23:01 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:23:01 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:23:01 user nova-compute[74658]:   </clock>
Nov 16 15:23:01 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:23:01 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:23:01 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:23:01 user nova-compute[74658]:   </cpu>
Nov 16 15:23:01 user nova-compute[74658]:   <devices>
Nov 16 15:23:01 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:23:01 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:23:01 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk"/>
Nov 16 15:23:01 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:23:01 user nova-compute[74658]:     </disk>
Nov 16 15:23:01 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:23:01 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:23:01 user nova-compute[74658]:       <source dev="/dev/sdc"/>
Nov 16 15:23:01 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:23:01 user nova-compute[74658]:       <serial>e52739fd-550d-422e-85ea-ac2c985424d0</serial>
Nov 16 15:23:01 user nova-compute[74658]:     </disk>
Nov 16 15:23:01 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:23:01 user nova-compute[74658]:       <mac address="fa:16:3e:67:46:cc"/>
Nov 16 15:23:01 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:23:01 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:23:01 user nova-compute[74658]:       <target dev="tap7cd5fe13-ad"/>
Nov 16 15:23:01 user nova-compute[74658]:     </interface>
Nov 16 15:23:01 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:23:01 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/console.log" append="off"/>
Nov 16 15:23:01 user nova-compute[74658]:     </serial>
Nov 16 15:23:01 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:23:01 user nova-compute[74658]:     <video>
Nov 16 15:23:01 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:23:01 user nova-compute[74658]:     </video>
Nov 16 15:23:01 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:23:01 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:23:01 user nova-compute[74658]:     </rng>
Nov 16 15:23:01 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:23:01 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:23:01 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:23:01 user nova-compute[74658]:     </memballoon>
Nov 16 15:23:01 user nova-compute[74658]:   </devices>
Nov 16 15:23:01 user nova-compute[74658]: </domain>
Nov 16 15:23:01 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-973719147',display_name='tempest-ServerActionsTestOtherA-server-690127439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-973719147',id=14,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl++RKbB4aUMtrYmCOPdauQa/gpN9opiKUp/X+UapEvp1+7Y6F8dw6oyEwiFoEntT82tpQ3YHK6HAURo3UVwXD4GvU0Ji0v1dRcPaNdtl8esG6M51w55UWC2mDAZTpGjw==',key_name='tempest-keypair-851894490',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:20:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-kms34bsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:22:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=e1a0ba07-9784-4984-a0a2-4dd1d55cb53d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG os_vif [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a0a513-771c-4b58-a512-5b8836ae269c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b54aef80-4ec3-5081-864c-3ee158294c7d', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[546cbb38-16c6-4532-a097-88b10e6a2909]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cd5fe13-ad, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cd5fe13-ad, col_values=(('qos', UUID('cf1ec246-46a1-4bc7-9e6e-ea99c42d981a')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cd5fe13-ad, col_values=(('external_ids', {'iface-id': '7cd5fe13-ad8c-4d41-9e1e-09d269fd8685', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:46:cc', 'vm-uuid': 'e1a0ba07-9784-4984-a0a2-4dd1d55cb53d'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:23:01 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c03938-0c32-4138-acb0-04ca22dd1691]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG os_brick.utils [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Updating existing volume attachment record: ad5ad419-ecf8-4974-a162-b3ca7a3add1e {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:01 user nova-compute[74658]: INFO os_vif [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad')
Nov 16 15:23:01 user nova-compute[74658]: INFO nova.compute.manager [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Swapping old allocation on dict_keys(['16aee638-e9e1-41bd-94a9-c6d2aeb81dee']) held by migration f3c2298c-e980-4f50-b9f1-5bd6118c24c8 for instance
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No VIF found with MAC fa:16:3e:67:46:cc, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Overwriting current allocation {'allocations': {'16aee638-e9e1-41bd-94a9-c6d2aeb81dee': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': 'f1e465eeac8f4bc5b11c0a6e3a7bbc61', 'user_id': '9aa837a8e0f14644a3b6b0d3904213f2', 'consumer_generation': 1} on consumer 51f00d67-ae3d-4d1b-a721-280bae2e9caf {{(pid=74658) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquired lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:23:01 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-150a5496-177b-45e9-8c87-9bbeb8ead844 req-91b80497-6b4e-4a25-8e11-54ed9df9e777 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Received event network-changed-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-150a5496-177b-45e9-8c87-9bbeb8ead844 req-91b80497-6b4e-4a25-8e11-54ed9df9e777 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Refreshing instance network info cache due to event network-changed-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-150a5496-177b-45e9-8c87-9bbeb8ead844 req-91b80497-6b4e-4a25-8e11-54ed9df9e777 service nova] Acquiring lock "refresh_cache-ca6f21ea-8469-4805-9efe-5580a8dcea56" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-150a5496-177b-45e9-8c87-9bbeb8ead844 req-91b80497-6b4e-4a25-8e11-54ed9df9e777 service nova] Acquired lock "refresh_cache-ca6f21ea-8469-4805-9efe-5580a8dcea56" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG nova.network.neutron [req-150a5496-177b-45e9-8c87-9bbeb8ead844 req-91b80497-6b4e-4a25-8e11-54ed9df9e777 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Refreshing network info cache for port 67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating instance_info_cache with network_info: [{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Releasing lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG os_brick.utils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.037s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[614397c3-4066-40d9-adc1-792a521245d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cabff3-bc9e-4d20-8ec9-e0a6169bbba0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa29ee-d2c3-4ae0-ac14-9434414d581e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cb175c-5ee4-4da0-b975-214f89158ffd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:23:02 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3505c5c8-172f-489d-ae3f-1928d8279317]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG os_brick.utils [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG nova.network.neutron [req-150a5496-177b-45e9-8c87-9bbeb8ead844 req-91b80497-6b4e-4a25-8e11-54ed9df9e777 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Updated VIF entry in instance network info cache for port 67ce586f-dbb2-46b3-84cc-5d3ffdcc8680. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG nova.network.neutron [req-150a5496-177b-45e9-8c87-9bbeb8ead844 req-91b80497-6b4e-4a25-8e11-54ed9df9e777 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Updating instance_info_cache with network_info: [{"id": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "address": "fa:16:3e:8d:00:13", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ce586f-db", "ovs_interfaceid": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-150a5496-177b-45e9-8c87-9bbeb8ead844 req-91b80497-6b4e-4a25-8e11-54ed9df9e777 service nova] Releasing lock "refresh_cache-ca6f21ea-8469-4805-9efe-5580a8dcea56" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 7ef751d1-099a-4b46-b08d-99929d449ef9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-a00b8aff-d6d4-4f5d-b441-24f8c0990f68 req-252f012c-932e-473f-8d00-1a4dee3f0261 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a00b8aff-d6d4-4f5d-b441-24f8c0990f68 req-252f012c-932e-473f-8d00-1a4dee3f0261 service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a00b8aff-d6d4-4f5d-b441-24f8c0990f68 req-252f012c-932e-473f-8d00-1a4dee3f0261 service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a00b8aff-d6d4-4f5d-b441-24f8c0990f68 req-252f012c-932e-473f-8d00-1a4dee3f0261 service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-a00b8aff-d6d4-4f5d-b441-24f8c0990f68 req-252f012c-932e-473f-8d00-1a4dee3f0261 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:03 user nova-compute[74658]: WARNING nova.compute.manager [req-a00b8aff-d6d4-4f5d-b441-24f8c0990f68 req-252f012c-932e-473f-8d00-1a4dee3f0261 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received unexpected event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 15:23:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updating instance_info_cache with network_info: [{"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:23:05 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Instance spawned successfully.
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-72c15731-8aba-49a1-b654-924dc58f72f3 req-c81294f6-9e87-4e01-9b3a-477c41b73384 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-72c15731-8aba-49a1-b654-924dc58f72f3 req-c81294f6-9e87-4e01-9b3a-477c41b73384 service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-72c15731-8aba-49a1-b654-924dc58f72f3 req-c81294f6-9e87-4e01-9b3a-477c41b73384 service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-72c15731-8aba-49a1-b654-924dc58f72f3 req-c81294f6-9e87-4e01-9b3a-477c41b73384 service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-72c15731-8aba-49a1-b654-924dc58f72f3 req-c81294f6-9e87-4e01-9b3a-477c41b73384 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:05 user nova-compute[74658]: WARNING nova.compute.manager [req-72c15731-8aba-49a1-b654-924dc58f72f3 req-c81294f6-9e87-4e01-9b3a-477c41b73384 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received unexpected event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 15:23:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74658) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 15:23:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a795a5-03c8-4843-b516-7c2eedaa60e9 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.151s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmYpqfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:23:07 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:23:07 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:23:07 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e72ae3-b918-499c-a90e-cb02e972451f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:23:07 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9feb6f2-57b5-452c-8727-8fb18ff60b3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42] added
Nov 16 15:23:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde7f1c7-e2fe-4e31-8091-dc19290710dc]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d821d5-dd0e-401c-99b8-730adf1b2d5a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMmYpqfu {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMmYpqfu" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1d08bf-1db4-46b7-9a8d-1962ed15556b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMmYpqfu'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d32ea18-bfd3-4632-b738-23fd491c4ce5]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c72a091-05f0-4121-993e-b59c222af6eb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: INFO nova.compute.manager [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] instance snapshotting
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96d176a-fda6-46af-b00e-dd305562d8d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42, portal: 172.16.0.220,3260]
Nov 16 15:23:07 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42, portal: 172.16.0.220,3260] successful.
Nov 16 15:23:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Beginning live snapshot process
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[062b0125-150c-4795-b06b-906e7cfd8162]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a48894b-a62d-44c6-9689-7cd3394865e9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdb3acb-c400-476b-88dc-5fd52b4f09c0]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmYpqfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json -f qcow2 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json -f qcow2 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Starting finish_revert_migration {{(pid=74658) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.256s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp532lwoun/d4582e554b804899918a7ee4d43f7329.delta 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Start _get_guest_xml network_info=[{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ce2943b9-9ffa-4c5a-b206-1f396358b221', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZfabDrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '51f00d67-ae3d-4d1b-a721-280bae2e9caf', 'attached_at': '2023-11-16T15:23:08.000000', 'detached_at': '', 'volume_id': 'bb4b2049-384a-4e93-a6ce-2b020659e81d', 'serial': 'bb4b2049-384a-4e93-a6ce-2b020659e81d'}, 'boot_index': None, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp532lwoun/d4582e554b804899918a7ee4d43f7329.delta 1073741824" returned: 0 in 0.056s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 15:23:08 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:23:08 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51f00d67-ae3d-4d1b-a721-280bae2e9caf {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZfabDrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:23:08 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23831653764616633', 'path': '/dev/sdg'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831653764616633', 'path': '/dev/sdg'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.116s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:23:08 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:23:08 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.objects.instance [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lazy-loading 'flavor' on Instance uuid ca6f21ea-8469-4805-9efe-5580a8dcea56 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcc17f3-c40f-46f8-b4ef-c93ab6695936]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:23:08 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:23:08 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:23:08 user nova-compute[74658]:   <source dev="/dev/sdg"/>
Nov 16 15:23:08 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:23:08 user nova-compute[74658]:   <serial>6eeab32a-36c2-4d08-82c8-5f70f1921f42</serial>
Nov 16 15:23:08 user nova-compute[74658]: </disk>
Nov 16 15:23:08 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3aae69-f4ef-493c-bd75-9e03d79835be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d] added
Nov 16 15:23:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa41b96a-920d-4b1e-930c-25f40f23911e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7dee61-4bf5-4f4b-a5bd-6fc1f5b476e7]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZfabDrQ {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZfabDrQ" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e022b67-982f-4f81-a73f-29927619b322]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZfabDrQ'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c4fcde-9d42-46dd-9c94-05f97d559737]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9a93ab-3785-4742-9c89-fd9fa70d59c8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2d83ce-cc19-4d4f-a4b4-f13a0d0a719b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]
Nov 16 15:23:08 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.
Nov 16 15:23:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e08a512-b02c-430c-89c5-09e4946b9d7f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de10ab3-9975-4ce9-99e6-be8025efabff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:08 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] HCTL ('39', '-', '-', 0) found on session 24 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba6a2d6-0441-4865-9cfb-733b477abdc8]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] COPY block job progress, current cursor: 23068672 final cursor: 75497472 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] No VIF found with MAC fa:16:3e:8d:00:13, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c637f72d-96cb-41d6-896d-cfa00f47cb19 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.689s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZfabDrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] <== connect_volume: return (1530ms) {'type': 'block', 'scsi_wwn': '23131386261666362', 'path': '/dev/sdh'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131386261666362', 'path': '/dev/sdh'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1901009930',display_name='tempest-ServerActionsTestOtherB-server-1901009930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1901009930',id=5,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfYsAQlC3nkxAyuTL+KN50dEAunY5gw1KQEIPq+iR4mJ4asJBSmjta4eGNIIDBn+5Mv+AkdxZhEfTWggAEXb2LpORaOL7hjybIPHi4K1ldg1rK7G6KYvZmZ7N35zLKD+g==',key_name='tempest-keypair-983162783',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1e465eeac8f4bc5b11c0a6e3a7bbc61',ramdisk_id='',reservation_id='r-gupt4lp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-662756880',owner_user_name='tempest-ServerActionsTestOtherB-662756880-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aa837a8e0f14644a3b6b0d3904213f2',uuid=51f00d67-ae3d-4d1b-a721-280bae2e9caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converting VIF {"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:23:09 user nova-compute[74658]:   <uuid>51f00d67-ae3d-4d1b-a721-280bae2e9caf</uuid>
Nov 16 15:23:09 user nova-compute[74658]:   <name>instance-00000005</name>
Nov 16 15:23:09 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:23:09 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:23:09 user nova-compute[74658]:   <metadata>
Nov 16 15:23:09 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:23:09 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:23:09 user nova-compute[74658]:       <nova:name>tempest-ServerActionsTestOtherB-server-1901009930</nova:name>
Nov 16 15:23:09 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:23:08</nova:creationTime>
Nov 16 15:23:09 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:23:09 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:23:09 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:23:09 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:23:09 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:23:09 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:23:09 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:23:09 user nova-compute[74658]:       <nova:owner>
Nov 16 15:23:09 user nova-compute[74658]:         <nova:user uuid="9aa837a8e0f14644a3b6b0d3904213f2">tempest-ServerActionsTestOtherB-662756880-project-member</nova:user>
Nov 16 15:23:09 user nova-compute[74658]:         <nova:project uuid="f1e465eeac8f4bc5b11c0a6e3a7bbc61">tempest-ServerActionsTestOtherB-662756880</nova:project>
Nov 16 15:23:09 user nova-compute[74658]:       </nova:owner>
Nov 16 15:23:09 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:23:09 user nova-compute[74658]:       <nova:ports>
Nov 16 15:23:09 user nova-compute[74658]:         <nova:port uuid="6abed81e-257d-4d47-a1b8-586c040fdc92">
Nov 16 15:23:09 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 15:23:09 user nova-compute[74658]:         </nova:port>
Nov 16 15:23:09 user nova-compute[74658]:       </nova:ports>
Nov 16 15:23:09 user nova-compute[74658]:     </nova:instance>
Nov 16 15:23:09 user nova-compute[74658]:   </metadata>
Nov 16 15:23:09 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:23:09 user nova-compute[74658]:     <system>
Nov 16 15:23:09 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:23:09 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:23:09 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:23:09 user nova-compute[74658]:       <entry name="serial">51f00d67-ae3d-4d1b-a721-280bae2e9caf</entry>
Nov 16 15:23:09 user nova-compute[74658]:       <entry name="uuid">51f00d67-ae3d-4d1b-a721-280bae2e9caf</entry>
Nov 16 15:23:09 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:23:09 user nova-compute[74658]:     </system>
Nov 16 15:23:09 user nova-compute[74658]:   </sysinfo>
Nov 16 15:23:09 user nova-compute[74658]:   <os>
Nov 16 15:23:09 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:23:09 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:23:09 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:23:09 user nova-compute[74658]:   </os>
Nov 16 15:23:09 user nova-compute[74658]:   <features>
Nov 16 15:23:09 user nova-compute[74658]:     <acpi/>
Nov 16 15:23:09 user nova-compute[74658]:     <apic/>
Nov 16 15:23:09 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:23:09 user nova-compute[74658]:   </features>
Nov 16 15:23:09 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:23:09 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:23:09 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:23:09 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:23:09 user nova-compute[74658]:   </clock>
Nov 16 15:23:09 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:23:09 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:23:09 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:23:09 user nova-compute[74658]:   </cpu>
Nov 16 15:23:09 user nova-compute[74658]:   <devices>
Nov 16 15:23:09 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:23:09 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:23:09 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk"/>
Nov 16 15:23:09 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:23:09 user nova-compute[74658]:     </disk>
Nov 16 15:23:09 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:23:09 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:23:09 user nova-compute[74658]:       <source dev="/dev/sdh"/>
Nov 16 15:23:09 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:23:09 user nova-compute[74658]:       <serial>bb4b2049-384a-4e93-a6ce-2b020659e81d</serial>
Nov 16 15:23:09 user nova-compute[74658]:     </disk>
Nov 16 15:23:09 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:23:09 user nova-compute[74658]:       <mac address="fa:16:3e:83:53:58"/>
Nov 16 15:23:09 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:23:09 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:23:09 user nova-compute[74658]:       <target dev="tap6abed81e-25"/>
Nov 16 15:23:09 user nova-compute[74658]:     </interface>
Nov 16 15:23:09 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:23:09 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/console.log" append="off"/>
Nov 16 15:23:09 user nova-compute[74658]:     </serial>
Nov 16 15:23:09 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:23:09 user nova-compute[74658]:     <video>
Nov 16 15:23:09 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:23:09 user nova-compute[74658]:     </video>
Nov 16 15:23:09 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:23:09 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:23:09 user nova-compute[74658]:     </rng>
Nov 16 15:23:09 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:23:09 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:23:09 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:23:09 user nova-compute[74658]:     </memballoon>
Nov 16 15:23:09 user nova-compute[74658]:   </devices>
Nov 16 15:23:09 user nova-compute[74658]: </domain>
Nov 16 15:23:09 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1901009930',display_name='tempest-ServerActionsTestOtherB-server-1901009930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1901009930',id=5,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfYsAQlC3nkxAyuTL+KN50dEAunY5gw1KQEIPq+iR4mJ4asJBSmjta4eGNIIDBn+5Mv+AkdxZhEfTWggAEXb2LpORaOL7hjybIPHi4K1ldg1rK7G6KYvZmZ7N35zLKD+g==',key_name='tempest-keypair-983162783',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1e465eeac8f4bc5b11c0a6e3a7bbc61',ramdisk_id='',reservation_id='r-gupt4lp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-662756880',owner_user_name='tempest-ServerActionsTestOtherB-662756880-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aa837a8e0f14644a3b6b0d3904213f2',uuid=51f00d67-ae3d-4d1b-a721-280bae2e9caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converting VIF {"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG os_vif [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48b27d98-e2cd-5680-87f6-fa2549355058', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6abed81e-25, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6abed81e-25, col_values=(('qos', UUID('5563b2f2-9f41-425f-bea7-157e9d425e79')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6abed81e-25, col_values=(('external_ids', {'iface-id': '6abed81e-257d-4d47-a1b8-586c040fdc92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:53:58', 'vm-uuid': '51f00d67-ae3d-4d1b-a721-280bae2e9caf'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:09 user nova-compute[74658]: INFO os_vif [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25')
Nov 16 15:23:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:23:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 15:23:10 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:23:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp532lwoun/d4582e554b804899918a7ee4d43f7329.delta /opt/stack/data/nova/instances/snapshots/tmp532lwoun/d4582e554b804899918a7ee4d43f7329 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp532lwoun/d4582e554b804899918a7ee4d43f7329.delta /opt/stack/data/nova/instances/snapshots/tmp532lwoun/d4582e554b804899918a7ee4d43f7329" returned: 0 in 0.839s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:11 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Snapshot extracted, beginning image upload
Nov 16 15:23:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-b2d3e31a-3811-4fae-81e9-7c26b00875d1 req-07f8e223-43da-4502-b130-2a9324f9ccbb service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b2d3e31a-3811-4fae-81e9-7c26b00875d1 req-07f8e223-43da-4502-b130-2a9324f9ccbb service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b2d3e31a-3811-4fae-81e9-7c26b00875d1 req-07f8e223-43da-4502-b130-2a9324f9ccbb service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b2d3e31a-3811-4fae-81e9-7c26b00875d1 req-07f8e223-43da-4502-b130-2a9324f9ccbb service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-b2d3e31a-3811-4fae-81e9-7c26b00875d1 req-07f8e223-43da-4502-b130-2a9324f9ccbb service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:11 user nova-compute[74658]: WARNING nova.compute.manager [req-b2d3e31a-3811-4fae-81e9-7c26b00875d1 req-07f8e223-43da-4502-b130-2a9324f9ccbb service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received unexpected event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with vm_state resized and task_state resize_reverting.
Nov 16 15:23:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-327c0256-461b-4ca2-8580-09a098516579 req-4925880a-a1e8-442d-9920-2eca79bf00e7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-327c0256-461b-4ca2-8580-09a098516579 req-4925880a-a1e8-442d-9920-2eca79bf00e7 service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-327c0256-461b-4ca2-8580-09a098516579 req-4925880a-a1e8-442d-9920-2eca79bf00e7 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-327c0256-461b-4ca2-8580-09a098516579 req-4925880a-a1e8-442d-9920-2eca79bf00e7 service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-327c0256-461b-4ca2-8580-09a098516579 req-4925880a-a1e8-442d-9920-2eca79bf00e7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:14 user nova-compute[74658]: WARNING nova.compute.manager [req-327c0256-461b-4ca2-8580-09a098516579 req-4925880a-a1e8-442d-9920-2eca79bf00e7 service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received unexpected event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with vm_state resized and task_state resize_reverting.
Nov 16 15:23:14 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Snapshot image upload complete
Nov 16 15:23:14 user nova-compute[74658]: INFO nova.compute.manager [None req-e72be570-0a81-4db6-ad18-e65c96c2137d tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Took 6.77 seconds to snapshot the instance on the hypervisor.
Nov 16 15:23:14 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:23:14 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance running successfully.
Nov 16 15:23:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] finish_revert_migration finished successfully. {{(pid=74658) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 16 15:23:14 user nova-compute[74658]: INFO nova.compute.manager [None req-5519edc2-aead-499b-9411-911ad06bb061 tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating instance to original state: 'active'
Nov 16 15:23:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_power_states {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 7ef751d1-099a-4b46-b08d-99929d449ef9 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 03cbebbf-5414-4309-bfc1-ec0a67e09a7c {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 51f00d67-ae3d-4d1b-a721-280bae2e9caf {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid e1a0ba07-9784-4984-a0a2-4dd1d55cb53d {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid ca6f21ea-8469-4805-9efe-5580a8dcea56 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 766f2096-3fe3-4d6f-93cd-2a07c8967197 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid ddbd0152-96d0-4c58-bda2-a0fe2c905c28 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid bf2fe627-5a1c-44f0-b872-1d4275baac59 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "7ef751d1-099a-4b46-b08d-99929d449ef9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:22 user nova-compute[74658]: INFO nova.compute.manager [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Detaching volume 6eeab32a-36c2-4d08-82c8-5f70f1921f42
Nov 16 15:23:22 user nova-compute[74658]: INFO nova.virt.block_device [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Attempting to driver detach volume 6eeab32a-36c2-4d08-82c8-5f70f1921f42 from mountpoint /dev/vdb
Nov 16 15:23:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Attempting to detach device vdb from instance ca6f21ea-8469-4805-9efe-5580a8dcea56 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:23:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:23:22 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:23:22 user nova-compute[74658]:   <source dev="/dev/sdg"/>
Nov 16 15:23:22 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:23:22 user nova-compute[74658]:   <serial>6eeab32a-36c2-4d08-82c8-5f70f1921f42</serial>
Nov 16 15:23:22 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:23:22 user nova-compute[74658]: </disk>
Nov 16 15:23:22 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:23:22 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Successfully detached device vdb from instance ca6f21ea-8469-4805-9efe-5580a8dcea56 from the persistent domain config.
Nov 16 15:23:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca6f21ea-8469-4805-9efe-5580a8dcea56 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:23:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:23:22 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:23:22 user nova-compute[74658]:   <source dev="/dev/sdg"/>
Nov 16 15:23:22 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:23:22 user nova-compute[74658]:   <serial>6eeab32a-36c2-4d08-82c8-5f70f1921f42</serial>
Nov 16 15:23:22 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:23:22 user nova-compute[74658]: </disk>
Nov 16 15:23:22 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:23:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca6f21ea-8469-4805-9efe-5580a8dcea56 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:23:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:24 user nova-compute[74658]: INFO nova.compute.manager [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Detaching volume 1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:23:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:24 user nova-compute[74658]: INFO nova.virt.block_device [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Attempting to driver detach volume 1e38a4c3-f416-4157-9c21-063e29002b7d from mountpoint /dev/vdb
Nov 16 15:23:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Attempting to detach device vdb from instance e06fcb99-9271-48da-ac95-3998d45e6ccb from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:23:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:23:24 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:23:24 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:23:24 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:23:24 user nova-compute[74658]:   <serial>1e38a4c3-f416-4157-9c21-063e29002b7d</serial>
Nov 16 15:23:24 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:23:24 user nova-compute[74658]: </disk>
Nov 16 15:23:24 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:23:24 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Successfully detached device vdb from instance e06fcb99-9271-48da-ac95-3998d45e6ccb from the persistent domain config.
Nov 16 15:23:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e06fcb99-9271-48da-ac95-3998d45e6ccb from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:23:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:23:24 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:23:24 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:23:24 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:23:24 user nova-compute[74658]:   <serial>1e38a4c3-f416-4157-9c21-063e29002b7d</serial>
Nov 16 15:23:24 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:23:24 user nova-compute[74658]: </disk>
Nov 16 15:23:24 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:23:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:23:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:32 user nova-compute[74658]: DEBUG nova.compute.manager [req-2a9619d3-e3a2-471e-8f98-363202c1a33e req-5bbd1e29-add4-4362-9dba-478bd2d0cbda service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-changed-4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:32 user nova-compute[74658]: DEBUG nova.compute.manager [req-2a9619d3-e3a2-471e-8f98-363202c1a33e req-5bbd1e29-add4-4362-9dba-478bd2d0cbda service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing instance network info cache due to event network-changed-4ee3a8b1-11de-4a46-9882-792af7e1b625. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:23:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a9619d3-e3a2-471e-8f98-363202c1a33e req-5bbd1e29-add4-4362-9dba-478bd2d0cbda service nova] Acquiring lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:23:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a9619d3-e3a2-471e-8f98-363202c1a33e req-5bbd1e29-add4-4362-9dba-478bd2d0cbda service nova] Acquired lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:23:32 user nova-compute[74658]: DEBUG nova.network.neutron [req-2a9619d3-e3a2-471e-8f98-363202c1a33e req-5bbd1e29-add4-4362-9dba-478bd2d0cbda service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Refreshing network info cache for port 4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:23:32 user nova-compute[74658]: DEBUG nova.network.neutron [req-2a9619d3-e3a2-471e-8f98-363202c1a33e req-5bbd1e29-add4-4362-9dba-478bd2d0cbda service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updated VIF entry in instance network info cache for port 4ee3a8b1-11de-4a46-9882-792af7e1b625. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:23:32 user nova-compute[74658]: DEBUG nova.network.neutron [req-2a9619d3-e3a2-471e-8f98-363202c1a33e req-5bbd1e29-add4-4362-9dba-478bd2d0cbda service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating instance_info_cache with network_info: [{"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:23:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a9619d3-e3a2-471e-8f98-363202c1a33e req-5bbd1e29-add4-4362-9dba-478bd2d0cbda service nova] Releasing lock "refresh_cache-ddbd0152-96d0-4c58-bda2-a0fe2c905c28" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:23:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:35 user nova-compute[74658]: INFO nova.compute.manager [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Terminating instance
Nov 16 15:23:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-5581b913-d610-433a-8427-5cbeeea0b25a req-4d099efa-9421-43e5-a234-fe3c4ec1da6d service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5581b913-d610-433a-8427-5cbeeea0b25a req-4d099efa-9421-43e5-a234-fe3c4ec1da6d service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5581b913-d610-433a-8427-5cbeeea0b25a req-4d099efa-9421-43e5-a234-fe3c4ec1da6d service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5581b913-d610-433a-8427-5cbeeea0b25a req-4d099efa-9421-43e5-a234-fe3c4ec1da6d service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-5581b913-d610-433a-8427-5cbeeea0b25a req-4d099efa-9421-43e5-a234-fe3c4ec1da6d service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-unplugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-5581b913-d610-433a-8427-5cbeeea0b25a req-4d099efa-9421-43e5-a234-fe3c4ec1da6d service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-7becb6ba-b188-4d26-a9ce-f138f2a20f5c req-7e3b4d5c-7a97-4fda-862d-a32bb0a6a573 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-593b4c31-e20e-46a4-ae7f-33b951762c4a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7becb6ba-b188-4d26-a9ce-f138f2a20f5c req-7e3b4d5c-7a97-4fda-862d-a32bb0a6a573 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7becb6ba-b188-4d26-a9ce-f138f2a20f5c req-7e3b4d5c-7a97-4fda-862d-a32bb0a6a573 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7becb6ba-b188-4d26-a9ce-f138f2a20f5c req-7e3b4d5c-7a97-4fda-862d-a32bb0a6a573 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-7becb6ba-b188-4d26-a9ce-f138f2a20f5c req-7e3b4d5c-7a97-4fda-862d-a32bb0a6a573 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-unplugged-593b4c31-e20e-46a4-ae7f-33b951762c4a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-7becb6ba-b188-4d26-a9ce-f138f2a20f5c req-7e3b4d5c-7a97-4fda-862d-a32bb0a6a573 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-593b4c31-e20e-46a4-ae7f-33b951762c4a for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Instance destroyed successfully.
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.objects.instance [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lazy-loading 'resources' on Instance uuid ddbd0152-96d0-4c58-bda2-a0fe2c905c28 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "address": "fa:16:3e:e2:78:5e", "network": {"id": "623a9856-948d-4c92-9256-662df539a75c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-18266856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee3a8b1-11", "ovs_interfaceid": "4ee3a8b1-11de-4a46-9882-792af7e1b625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=4ee3a8b1-11de-4a46-9882-792af7e1b625,network=Network(623a9856-948d-4c92-9256-662df539a75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee3a8b1-11') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=4ee3a8b1-11de-4a46-9882-792af7e1b625,network=Network(623a9856-948d-4c92-9256-662df539a75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee3a8b1-11') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ee3a8b1-11, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ef644bc-fdcb-4fe1-893b-1ab080e873a9) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: INFO os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=4ee3a8b1-11de-4a46-9882-792af7e1b625,network=Network(623a9856-948d-4c92-9256-662df539a75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee3a8b1-11')
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=625eadf6-4b3f-4dda-ac0a-33bdde1e938c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap625eadf6-4b') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=625eadf6-4b3f-4dda-ac0a-33bdde1e938c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap625eadf6-4b') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap625eadf6-4b, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c7f42fe-bc45-4dab-ba54-56cf5b04cab9) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: INFO os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=625eadf6-4b3f-4dda-ac0a-33bdde1e938c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap625eadf6-4b')
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:c7:f5,bridge_name='br-int',has_traffic_filtering=True,id=593b4c31-e20e-46a4-ae7f-33b951762c4a,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap593b4c31-e2') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:c7:f5,bridge_name='br-int',has_traffic_filtering=True,id=593b4c31-e20e-46a4-ae7f-33b951762c4a,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap593b4c31-e2') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap593b4c31-e2, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b7f26b0-f8af-4053-8d93-80457674d6a9) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: INFO os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:c7:f5,bridge_name='br-int',has_traffic_filtering=True,id=593b4c31-e20e-46a4-ae7f-33b951762c4a,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap593b4c31-e2')
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:8e,bridge_name='br-int',has_traffic_filtering=True,id=68d9dea1-bd8e-45b5-9f04-90bc3879e48c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d9dea1-bd') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:8e,bridge_name='br-int',has_traffic_filtering=True,id=68d9dea1-bd8e-45b5-9f04-90bc3879e48c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d9dea1-bd') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68d9dea1-bd, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c24f46c1-f029-423f-b578-a9afa2da4e8d) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: WARNING nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-4ee3a8b1-11de-4a46-9882-792af7e1b625 for instance with vm_state active and task_state deleting.
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-unplugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: WARNING nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-625eadf6-4b3f-4dda-ac0a-33bdde1e938c for instance with vm_state active and task_state deleting.
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-unplugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: WARNING nova.compute.manager [req-2d2a9c71-428e-44ec-9203-49946ee3f664 req-db235cd8-0690-4b50-9bb6-f5e35080ecf3 service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-6d1585ce-3521-411d-bafd-e1bd7a147cbb for instance with vm_state active and task_state deleting.
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: INFO os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:8e,bridge_name='br-int',has_traffic_filtering=True,id=68d9dea1-bd8e-45b5-9f04-90bc3879e48c,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d9dea1-bd')
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f9:68,bridge_name='br-int',has_traffic_filtering=True,id=6d1585ce-3521-411d-bafd-e1bd7a147cbb,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1585ce-35') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f9:68,bridge_name='br-int',has_traffic_filtering=True,id=6d1585ce-3521-411d-bafd-e1bd7a147cbb,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1585ce-35') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d1585ce-35, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1a0a559-0637-49ef-a92a-0c7b908b1bd7) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: INFO os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f9:68,bridge_name='br-int',has_traffic_filtering=True,id=6d1585ce-3521-411d-bafd-e1bd7a147cbb,network=Network(bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1585ce-35')
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:75:1f,bridge_name='br-int',has_traffic_filtering=True,id=eafee381-ea25-4cd4-8a86-a4e61b15c9a6,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafee381-ea') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:75:1f,bridge_name='br-int',has_traffic_filtering=True,id=eafee381-ea25-4cd4-8a86-a4e61b15c9a6,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafee381-ea') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeafee381-ea, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de0410ae-bda5-4f3c-9538-9e6edc7da189) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: INFO os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:75:1f,bridge_name='br-int',has_traffic_filtering=True,id=eafee381-ea25-4cd4-8a86-a4e61b15c9a6,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafee381-ea')
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1675596307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1675596307',id=17,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbAfQCiDuyDqyKGWcQv0u+qM8pNgrHFR7Dxe5G1vPaUuN+LAO0Sm80PigaV227d8bnK0pyqbCuOM7hoMCHIpTZwky9Lpr8F9IJw0J9vOa4QcMh8LTzojSC1zxxKJLHp9w==',key_name='tempest-keypair-1480844411',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76870740e0af4590bb1978d56350b2d0',ramdisk_id='',reservation_id='r-avwt6neo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1243200656',owner_user_name='tempest-TaggedBootDevicesTest-1243200656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e8f5be4a304d57ba6bb75daa7fad6d',uuid=ddbd0152-96d0-4c58-bda2-a0fe2c905c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converting VIF {"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=914e7ce0-47f2-4022-84fe-b32da8fa9ad1,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914e7ce0-47') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=914e7ce0-47f2-4022-84fe-b32da8fa9ad1,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914e7ce0-47') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap914e7ce0-47, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0737833d-7711-4685-8c33-95e746847e41) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:37 user nova-compute[74658]: INFO os_vif [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=914e7ce0-47f2-4022-84fe-b32da8fa9ad1,network=Network(3955f738-4e59-4841-8b1d-7c5e6a86ba4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914e7ce0-47')
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfnQpjho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:23:37 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99e3ba1-d74c-42d9-aebd-feb09bdd4dde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:23:37 user nova-compute[74658]: No targets found.
Nov 16 15:23:37 user nova-compute[74658]: iSNS:
Nov 16 15:23:37 user nova-compute[74658]: No targets found.
Nov 16 15:23:37 user nova-compute[74658]: STATIC:
Nov 16 15:23:37 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458
Nov 16 15:23:37 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:37 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:37 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918
Nov 16 15:23:37 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:37 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:37 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42
Nov 16 15:23:37 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:37 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:37 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:23:37 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:37 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:37 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:23:37 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:37 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:37 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00
Nov 16 15:23:37 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:37 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:37 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:23:37 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:37 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:37 user nova-compute[74658]: FIRMWARE:
Nov 16 15:23:37 user nova-compute[74658]: No targets found.
Nov 16 15:23:37 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:23:37 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:23:37 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8382d7ab-29e0-4dcc-9051-0b74c0448334]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-593b4c31-e20e-46a4-ae7f-33b951762c4a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-593b4c31-e20e-46a4-ae7f-33b951762c4a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: WARNING nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-593b4c31-e20e-46a4-ae7f-33b951762c4a for instance with vm_state active and task_state deleting.
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-unplugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: WARNING nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-68d9dea1-bd8e-45b5-9f04-90bc3879e48c for instance with vm_state active and task_state deleting.
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-unplugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: WARNING nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 for instance with vm_state active and task_state deleting.
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-unplugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-unplugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-plugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Acquiring lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] No waiting events found dispatching network-vif-plugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:37 user nova-compute[74658]: WARNING nova.compute.manager [req-c9a42305-08f2-4eec-9f7e-fc49920257cf req-53bb0f9b-553d-45b5-8ed1-572a6ff9393a service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received unexpected event network-vif-plugged-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 for instance with vm_state active and task_state deleting.
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b1370f-1cc6-4aba-b275-87c6e52a50ec]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:37 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:37 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:37 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f071038acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00'): ({'sdd'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Removing single pathed devices sdd {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bb460b-037c-45e4-96dc-1f4352dd7679]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4d219f-7410-427f-8dea-0b3e2bb62faf]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Flushing IO for device /dev/sdd {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9d927c-ac05-44e7-a3c8-4c7f17859a80]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.030s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8265e837-f2f3-4bd2-a1b6-51424ae338d1]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce89ecc-a418-443d-a414-25b6faba916a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e252d4-a505-44af-9612-a656f406a4e5]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00, portal: 172.16.0.220,3260]
Nov 16 15:23:38 user nova-compute[74658]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00, portal: 172.16.0.220,3260] successful.
Nov 16 15:23:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c7f1e0-96ba-45e8-802a-1c93e3347c00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ee660e-2ddf-4ea9-8494-586152fdda1d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] <== disconnect_volume: return (339ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMhvwTPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:23:38 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[07152f9a-577d-4afa-90dd-6d29c4edeaf5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:23:38 user nova-compute[74658]: No targets found.
Nov 16 15:23:38 user nova-compute[74658]: iSNS:
Nov 16 15:23:38 user nova-compute[74658]: No targets found.
Nov 16 15:23:38 user nova-compute[74658]: STATIC:
Nov 16 15:23:38 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458
Nov 16 15:23:38 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:38 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:38 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918
Nov 16 15:23:38 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:38 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:38 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42
Nov 16 15:23:38 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:38 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:38 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:23:38 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:38 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:38 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:23:38 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:38 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:38 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:23:38 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:38 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:38 user nova-compute[74658]: FIRMWARE:
Nov 16 15:23:38 user nova-compute[74658]: No targets found.
Nov 16 15:23:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:23:38 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:23:38 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a2f91f-75fe-4c5d-a944-493a5ca29d1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf07fde4-0644-4a4f-acb5-74b76884150e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07100ff7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918'): ({'sde'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Removing single pathed devices sde {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a5a435-2182-4bd6-bc87-877c24399c33]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[33826787-8a57-435d-95af-f0ad6c237a2c]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Flushing IO for device /dev/sde {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4448623-7199-4d65-bfe2-b28f80c41ea1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65be874-a62b-42b7-aa6d-3b305268d58f]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] SCSI volumes sde have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b89e8d-098e-4ff6-9e2b-4ed620cca261]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0233cbf9-b0c4-4b97-88fd-3bee718545f2]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918, portal: 172.16.0.220,3260]
Nov 16 15:23:38 user nova-compute[74658]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918, portal: 172.16.0.220,3260] successful.
Nov 16 15:23:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5069ae-9be0-47e5-8274-48d9b2264918 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de7e4f2-a376-4c48-a1fa-a1832d3f39b0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] <== disconnect_volume: return (327ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzIymZVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:23:38 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed635b5a-7fc7-4819-98fd-dfc0d7c6edfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:23:38 user nova-compute[74658]: No targets found.
Nov 16 15:23:38 user nova-compute[74658]: iSNS:
Nov 16 15:23:38 user nova-compute[74658]: No targets found.
Nov 16 15:23:38 user nova-compute[74658]: STATIC:
Nov 16 15:23:38 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458
Nov 16 15:23:38 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:38 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:38 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42
Nov 16 15:23:38 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:38 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:38 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:23:38 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:38 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:38 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:23:38 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:38 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:38 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:23:38 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:38 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:38 user nova-compute[74658]: FIRMWARE:
Nov 16 15:23:38 user nova-compute[74658]: No targets found.
Nov 16 15:23:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:23:38 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:23:38 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d261f9-0380-4e9b-95bd-a01b6755f4d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb64911b-7b64-4cdd-8ae3-123e62375c97]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:38 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07100ff7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458'): ({'sdf'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Removing single pathed devices sdf {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bc04eb-15de-49fe-9a63-4564204f4aef]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5d1eb5-b27f-4df0-88e2-e0b42c80ffe4]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Flushing IO for device /dev/sdf {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90f528c-8330-4f9e-821e-6ea5409d73e0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b066a0da-98be-484a-9fa1-09097a3b18d7]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] SCSI volumes sdf have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3581119-91c5-4752-96ca-7a14f88706bb]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb4cb95-84cb-4aa3-9af0-bfd4c3577e84]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458, portal: 172.16.0.220,3260]
Nov 16 15:23:38 user nova-compute[74658]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458, portal: 172.16.0.220,3260] successful.
Nov 16 15:23:38 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5280c452-4add-4c94-9e9a-92110d726458 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc14dcc-3d02-4f67-919c-6e8eed16d2e6]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] <== disconnect_volume: return (354ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:23:38 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Deleting instance files /opt/stack/data/nova/instances/ddbd0152-96d0-4c58-bda2-a0fe2c905c28_del
Nov 16 15:23:38 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Deletion of /opt/stack/data/nova/instances/ddbd0152-96d0-4c58-bda2-a0fe2c905c28_del complete
Nov 16 15:23:38 user nova-compute[74658]: INFO nova.compute.manager [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Took 3.66 seconds to destroy the instance on the hypervisor.
Nov 16 15:23:38 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:23:38 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:23:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:40 user nova-compute[74658]: DEBUG nova.compute.manager [req-6c5e0d73-2f40-47f9-b97f-3946f47f1b80 req-0523943e-9321-495d-9911-3f9aa227bede service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-deleted-4ee3a8b1-11de-4a46-9882-792af7e1b625 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:40 user nova-compute[74658]: INFO nova.compute.manager [req-6c5e0d73-2f40-47f9-b97f-3946f47f1b80 req-0523943e-9321-495d-9911-3f9aa227bede service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Neutron deleted interface 4ee3a8b1-11de-4a46-9882-792af7e1b625; detaching it from the instance and deleting it from the info cache
Nov 16 15:23:40 user nova-compute[74658]: DEBUG nova.network.neutron [req-6c5e0d73-2f40-47f9-b97f-3946f47f1b80 req-0523943e-9321-495d-9911-3f9aa227bede service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating instance_info_cache with network_info: [{"id": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "address": "fa:16:3e:a1:16:e5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625eadf6-4b", "ovs_interfaceid": "625eadf6-4b3f-4dda-ac0a-33bdde1e938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "address": "fa:16:3e:d7:c7:f5", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b4c31-e2", "ovs_interfaceid": "593b4c31-e20e-46a4-ae7f-33b951762c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "address": "fa:16:3e:a7:57:8e", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d9dea1-bd", "ovs_interfaceid": "68d9dea1-bd8e-45b5-9f04-90bc3879e48c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "address": "fa:16:3e:7f:f9:68", "network": {"id": "bc28fabe-8f33-4ae5-9333-c4a5f6c8ca3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1718788842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1585ce-35", "ovs_interfaceid": "6d1585ce-3521-411d-bafd-e1bd7a147cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "address": "fa:16:3e:c8:75:1f", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafee381-ea", "ovs_interfaceid": "eafee381-ea25-4cd4-8a86-a4e61b15c9a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "address": "fa:16:3e:4f:a2:94", "network": {"id": "3955f738-4e59-4841-8b1d-7c5e6a86ba4a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1102208771", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76870740e0af4590bb1978d56350b2d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914e7ce0-47", "ovs_interfaceid": "914e7ce0-47f2-4022-84fe-b32da8fa9ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:23:41 user nova-compute[74658]: DEBUG nova.compute.manager [req-6c5e0d73-2f40-47f9-b97f-3946f47f1b80 req-0523943e-9321-495d-9911-3f9aa227bede service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Detach interface failed, port_id=4ee3a8b1-11de-4a46-9882-792af7e1b625, reason: Instance ddbd0152-96d0-4c58-bda2-a0fe2c905c28 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:23:42 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Took 3.13 seconds to deallocate network for instance.
Nov 16 15:23:42 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ca6f21ea-8469-4805-9efe-5580a8dcea56 is timed out.
Nov 16 15:23:42 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Successfully detached device vdb from instance ca6f21ea-8469-4805-9efe-5580a8dcea56 from the live domain config.
Nov 16 15:23:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmYpqfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:23:42 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1237ec-9703-476a-bbd7-2cd9f469c3a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:23:42 user nova-compute[74658]: No targets found.
Nov 16 15:23:42 user nova-compute[74658]: iSNS:
Nov 16 15:23:42 user nova-compute[74658]: No targets found.
Nov 16 15:23:42 user nova-compute[74658]: STATIC:
Nov 16 15:23:42 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42
Nov 16 15:23:42 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:42 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:42 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:23:42 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:42 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:42 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:23:42 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:42 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:42 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:23:42 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:42 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:42 user nova-compute[74658]: FIRMWARE:
Nov 16 15:23:42 user nova-compute[74658]: No targets found.
Nov 16 15:23:42 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:23:42 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:23:42 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e374bc-e060-480e-bf9e-bbc698caca08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[92921c85-ebf6-4963-bba6-c4920f766cfe]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:42 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:42 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:42 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:42 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:42 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:42 user nova-compute[74658]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 (non-flash)
Nov 16 15:23:42 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:42 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f071011f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42'): ({'sdg'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Removing single pathed devices sdg {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd973a7-6e98-4ac8-99d5-0dea91d9ef3e]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e1febe-8882-489f-af14-3664002ad1f1]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Flushing IO for device /dev/sdg {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[651aea8b-31c8-4e00-ae05-b6735003c207]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-6d282ee9-8656-4a4f-8ece-995bdf1b4b98 req-96c3bc47-3b32-419a-8d2a-c1ff371cc6da service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-deleted-eafee381-ea25-4cd4-8a86-a4e61b15c9a6 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-6d282ee9-8656-4a4f-8ece-995bdf1b4b98 req-96c3bc47-3b32-419a-8d2a-c1ff371cc6da service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-deleted-914e7ce0-47f2-4022-84fe-b32da8fa9ad1 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-6d282ee9-8656-4a4f-8ece-995bdf1b4b98 req-96c3bc47-3b32-419a-8d2a-c1ff371cc6da service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-deleted-68d9dea1-bd8e-45b5-9f04-90bc3879e48c {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-6d282ee9-8656-4a4f-8ece-995bdf1b4b98 req-96c3bc47-3b32-419a-8d2a-c1ff371cc6da service nova] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Received event network-vif-deleted-6d1585ce-3521-411d-bafd-e1bd7a147cbb {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eadc6c-d95c-4e98-865f-ad7dc8609841]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] SCSI volumes sdg have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eaa4ec-4bcf-409c-a68a-f21a29cece5f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec13c886-379c-4f94-9245-b1d79d429149]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42, portal: 172.16.0.220,3260]
Nov 16 15:23:43 user nova-compute[74658]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42, portal: 172.16.0.220,3260] successful.
Nov 16 15:23:43 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b723c3-465e-4588-8443-57f8b7801eaf]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] <== disconnect_volume: return (318ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lazy-loading 'flavor' on Instance uuid ca6f21ea-8469-4805-9efe-5580a8dcea56 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0124b702-f7d2-41d4-b854-2be0d9c787a2 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.604s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.469s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:43 user nova-compute[74658]: INFO nova.compute.manager [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Terminating instance
Nov 16 15:23:43 user nova-compute[74658]: DEBUG nova.compute.manager [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-301c6b68-0cd5-49cf-9774-7ef061ab5128 req-8729ed93-135e-4304-9ee8-ae5ca225b891 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Received event network-vif-unplugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-301c6b68-0cd5-49cf-9774-7ef061ab5128 req-8729ed93-135e-4304-9ee8-ae5ca225b891 service nova] Acquiring lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-301c6b68-0cd5-49cf-9774-7ef061ab5128 req-8729ed93-135e-4304-9ee8-ae5ca225b891 service nova] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-301c6b68-0cd5-49cf-9774-7ef061ab5128 req-8729ed93-135e-4304-9ee8-ae5ca225b891 service nova] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-301c6b68-0cd5-49cf-9774-7ef061ab5128 req-8729ed93-135e-4304-9ee8-ae5ca225b891 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] No waiting events found dispatching network-vif-unplugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-301c6b68-0cd5-49cf-9774-7ef061ab5128 req-8729ed93-135e-4304-9ee8-ae5ca225b891 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Received event network-vif-unplugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:23:44 user nova-compute[74658]: INFO nova.compute.manager [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] [instance: ddbd0152-96d0-4c58-bda2-a0fe2c905c28] Took 2.19 seconds to detach 3 volumes for instance.
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:44 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Instance destroyed successfully.
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.objects.instance [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lazy-loading 'resources' on Instance uuid ca6f21ea-8469-4805-9efe-5580a8dcea56 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1142195448',display_name='tempest-VolumesSnapshotTestJSON-instance-1142195448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1142195448',id=15,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIjFcHU5I5YVVGvoH/06ibISQeAJxfWX5jCIqFc/hIKeHR5C549cpTLr/ovF1yVfu6IpT9N+oCeLN5bAZrsRLduZ94cwSx2II+frfeOnNH060F8G+XNpMjM8l1IE6476w==',key_name='tempest-keypair-791353115',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:21:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19164c5a777949f790615128d2ee350c',ramdisk_id='',reservation_id='r-7toegaz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1886586727',owner_user_name='tempest-VolumesSnapshotTestJSON-1886586727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3ae2183da41421f88946b3cea996833',uuid=ca6f21ea-8469-4805-9efe-5580a8dcea56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "address": "fa:16:3e:8d:00:13", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ce586f-db", "ovs_interfaceid": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converting VIF {"id": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "address": "fa:16:3e:8d:00:13", "network": {"id": "a59af0dc-e025-4213-b126-18e4fa707a09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1875166762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19164c5a777949f790615128d2ee350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ce586f-db", "ovs_interfaceid": "67ce586f-dbb2-46b3-84cc-5d3ffdcc8680", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:00:13,bridge_name='br-int',has_traffic_filtering=True,id=67ce586f-dbb2-46b3-84cc-5d3ffdcc8680,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ce586f-db') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_vif [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:00:13,bridge_name='br-int',has_traffic_filtering=True,id=67ce586f-dbb2-46b3-84cc-5d3ffdcc8680,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ce586f-db') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67ce586f-db, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5852a519-0776-42f2-b04c-449ee2195c64) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:44 user nova-compute[74658]: INFO os_vif [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:00:13,bridge_name='br-int',has_traffic_filtering=True,id=67ce586f-dbb2-46b3-84cc-5d3ffdcc8680,network=Network(a59af0dc-e025-4213-b126-18e4fa707a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ce586f-db')
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmYpqfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:23:44 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fdf979-6803-4e43-9e58-c802f6e08a7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:23:44 user nova-compute[74658]: No targets found.
Nov 16 15:23:44 user nova-compute[74658]: iSNS:
Nov 16 15:23:44 user nova-compute[74658]: No targets found.
Nov 16 15:23:44 user nova-compute[74658]: STATIC:
Nov 16 15:23:44 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:23:44 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:44 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:44 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:23:44 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:44 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:44 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:23:44 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:44 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:44 user nova-compute[74658]: FIRMWARE:
Nov 16 15:23:44 user nova-compute[74658]: No targets found.
Nov 16 15:23:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:23:44 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:23:44 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eeab32a-36c2-4d08-82c8-5f70f1921f42', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c455bc47-aad4-46e3-ac7b-51be5eb222f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[89399e01-e6d2-4ebc-be97-a0b7a00399ef]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:44 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:44 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:44 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:44 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0733db76d0>, {}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Disconnecting from: [] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] <== disconnect_volume: return (78ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:23:44 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Deleting instance files /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56_del
Nov 16 15:23:44 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Deletion of /opt/stack/data/nova/instances/ca6f21ea-8469-4805-9efe-5580a8dcea56_del complete
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:23:44 user nova-compute[74658]: INFO nova.compute.manager [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:23:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:44 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Deleted allocations for instance ddbd0152-96d0-4c58-bda2-a0fe2c905c28
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-11bd2596-bf62-48ef-ac2a-324873a4a364 tempest-TaggedBootDevicesTest-1243200656 tempest-TaggedBootDevicesTest-1243200656-project-member] Lock "ddbd0152-96d0-4c58-bda2-a0fe2c905c28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.732s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:45 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e06fcb99-9271-48da-ac95-3998d45e6ccb is timed out.
Nov 16 15:23:45 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Successfully detached device vdb from instance e06fcb99-9271-48da-ac95-3998d45e6ccb from the live domain config.
Nov 16 15:23:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAdlHtrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:23:45 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e70a32-180c-46ae-8ff3-d22a2347d17e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:23:45 user nova-compute[74658]: No targets found.
Nov 16 15:23:45 user nova-compute[74658]: iSNS:
Nov 16 15:23:45 user nova-compute[74658]: No targets found.
Nov 16 15:23:45 user nova-compute[74658]: STATIC:
Nov 16 15:23:45 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:23:45 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:45 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:45 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d
Nov 16 15:23:45 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:45 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:45 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:23:45 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:23:45 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:23:45 user nova-compute[74658]: FIRMWARE:
Nov 16 15:23:45 user nova-compute[74658]: No targets found.
Nov 16 15:23:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:23:45 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:23:45 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44fb382-e91b-40f0-98f4-b0efdc6745aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5759cbd5-ebc9-40ba-b8cf-71d9b53b1830]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:45 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:45 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d (non-flash)
Nov 16 15:23:45 user nova-compute[74658]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:23:45 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:23:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07101416c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[567e8810-be8e-456e-9d8d-e06a47f06b66]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.034s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa652f4-5be3-4df7-bf84-7e2d6e5eae60]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2745864-813b-405c-98b1-0836c1db9add]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d60aeb3-1088-4a87-9c5e-5f02711c90da]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:45 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Took 0.81 seconds to deallocate network for instance.
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3c1f40-4afa-412f-996f-c8d7db733f5c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-5e17c28a-a45a-46f3-8994-ac94f0d3d20d req-cf97449a-3632-45b5-86fd-d3a02c2850b7 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Received event network-vif-deleted-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:45 user nova-compute[74658]: WARNING nova.volume.cinder [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Attachment ad5ad419-ecf8-4974-a162-b3ca7a3add1e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ad5ad419-ecf8-4974-a162-b3ca7a3add1e. (HTTP 404) (Request-ID: req-840f8653-2828-47ad-a1cf-544985f061b4)
Nov 16 15:23:45 user nova-compute[74658]: INFO nova.compute.manager [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Took 0.03 seconds to detach 1 volumes for instance.
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b240ab7-99d6-4308-abac-307d0ed0291b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d, portal: 172.16.0.220,3260]
Nov 16 15:23:45 user nova-compute[74658]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d, portal: 172.16.0.220,3260] successful.
Nov 16 15:23:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e38a4c3-f416-4157-9c21-063e29002b7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78b80c3-3600-43a0-a3a0-4da6273aa84f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] <== disconnect_volume: return (365ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:23:46 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:23:46 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:23:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:46 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Deleted allocations for instance ca6f21ea-8469-4805-9efe-5580a8dcea56
Nov 16 15:23:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-221268a2-2714-45e0-8fce-4107b390364a req-ca10e945-9a7d-4316-b2d8-3b41129b5ff7 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Received event network-vif-plugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-221268a2-2714-45e0-8fce-4107b390364a req-ca10e945-9a7d-4316-b2d8-3b41129b5ff7 service nova] Acquiring lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-221268a2-2714-45e0-8fce-4107b390364a req-ca10e945-9a7d-4316-b2d8-3b41129b5ff7 service nova] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-221268a2-2714-45e0-8fce-4107b390364a req-ca10e945-9a7d-4316-b2d8-3b41129b5ff7 service nova] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-221268a2-2714-45e0-8fce-4107b390364a req-ca10e945-9a7d-4316-b2d8-3b41129b5ff7 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] No waiting events found dispatching network-vif-plugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:46 user nova-compute[74658]: WARNING nova.compute.manager [req-221268a2-2714-45e0-8fce-4107b390364a req-ca10e945-9a7d-4316-b2d8-3b41129b5ff7 service nova] [instance: ca6f21ea-8469-4805-9efe-5580a8dcea56] Received unexpected event network-vif-plugged-67ce586f-dbb2-46b3-84cc-5d3ffdcc8680 for instance with vm_state deleted and task_state None.
Nov 16 15:23:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-33147c56-bb21-4137-b360-15217e7ee955 tempest-VolumesSnapshotTestJSON-1886586727 tempest-VolumesSnapshotTestJSON-1886586727-project-member] Lock "ca6f21ea-8469-4805-9efe-5580a8dcea56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.433s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:46 user nova-compute[74658]: DEBUG nova.objects.instance [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'flavor' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aad247e8-b724-40a6-b112-53988f00074d tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.772s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-c560d509-20f4-49cd-a012-d0961d18cef6 req-44932049-cb27-4da4-961d-6046d6a01de1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-changed-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-c560d509-20f4-49cd-a012-d0961d18cef6 req-44932049-cb27-4da4-961d-6046d6a01de1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Refreshing instance network info cache due to event network-changed-7835b05b-5b80-4071-9f12-34a63399f7b8. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:23:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c560d509-20f4-49cd-a012-d0961d18cef6 req-44932049-cb27-4da4-961d-6046d6a01de1 service nova] Acquiring lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:23:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c560d509-20f4-49cd-a012-d0961d18cef6 req-44932049-cb27-4da4-961d-6046d6a01de1 service nova] Acquired lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:23:52 user nova-compute[74658]: DEBUG nova.network.neutron [req-c560d509-20f4-49cd-a012-d0961d18cef6 req-44932049-cb27-4da4-961d-6046d6a01de1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Refreshing network info cache for port 7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:23:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "interface-6aa0fa12-4970-442d-ae49-36266e774d68-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "interface-6aa0fa12-4970-442d-ae49-36266e774d68-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:53 user nova-compute[74658]: DEBUG nova.objects.instance [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lazy-loading 'flavor' on Instance uuid 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:53 user nova-compute[74658]: DEBUG nova.network.neutron [req-c560d509-20f4-49cd-a012-d0961d18cef6 req-44932049-cb27-4da4-961d-6046d6a01de1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updated VIF entry in instance network info cache for port 7835b05b-5b80-4071-9f12-34a63399f7b8. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:23:53 user nova-compute[74658]: DEBUG nova.network.neutron [req-c560d509-20f4-49cd-a012-d0961d18cef6 req-44932049-cb27-4da4-961d-6046d6a01de1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updating instance_info_cache with network_info: [{"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:23:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c560d509-20f4-49cd-a012-d0961d18cef6 req-44932049-cb27-4da4-961d-6046d6a01de1 service nova] Releasing lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:23:53 user nova-compute[74658]: DEBUG nova.objects.instance [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lazy-loading 'pci_requests' on Instance uuid 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:53 user nova-compute[74658]: DEBUG nova.objects.base [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Object Instance<6aa0fa12-4970-442d-ae49-36266e774d68> lazy-loaded attributes: flavor,pci_requests {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:23:53 user nova-compute[74658]: DEBUG nova.network.neutron [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:23:53 user nova-compute[74658]: DEBUG nova.policy [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa52214955ba4f01a25e5f74699f82b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246582f6f0c74a049de9e4d91f284c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:23:53 user nova-compute[74658]: DEBUG nova.network.neutron [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Successfully created port: 2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:23:54 user nova-compute[74658]: DEBUG nova.network.neutron [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Successfully updated port: 2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:23:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:23:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquired lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:23:54 user nova-compute[74658]: DEBUG nova.network.neutron [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:23:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-c55c6479-586b-4f74-a2f6-4859e4e684af req-0f93cc2b-d2ad-414f-a8f3-a7f789e0fd1e service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-changed-2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-c55c6479-586b-4f74-a2f6-4859e4e684af req-0f93cc2b-d2ad-414f-a8f3-a7f789e0fd1e service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Refreshing instance network info cache due to event network-changed-2793423f-ba0f-4844-8040-954152034998. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:23:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c55c6479-586b-4f74-a2f6-4859e4e684af req-0f93cc2b-d2ad-414f-a8f3-a7f789e0fd1e service nova] Acquiring lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.network.neutron [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updating instance_info_cache with network_info: [{"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Releasing lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c55c6479-586b-4f74-a2f6-4859e4e684af req-0f93cc2b-d2ad-414f-a8f3-a7f789e0fd1e service nova] Acquired lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-c55c6479-586b-4f74-a2f6-4859e4e684af req-0f93cc2b-d2ad-414f-a8f3-a7f789e0fd1e service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Refreshing network info cache for port 2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-195038505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-195038505',id=18,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUYALn+Qe4bwBouHMM172AwnuDCo8Hub97tHOoN+sL0yYCQQKPRlPEZKYjt7+tYhGGAM1S+tJ0NSYwnH68UBRN5GsdSVFRHkmY5xPtQI9glZ3saVVE/aVmRO8U+qZ4/ZA==',key_name='tempest-keypair-498949403',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='246582f6f0c74a049de9e4d91f284c9b',ramdisk_id='',reservation_id='r-jlw5bbtz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-281283563',owner_user_name='tempest-TaggedAttachmentsTest-281283563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa52214955ba4f01a25e5f74699f82b4',uuid=6aa0fa12-4970-442d-ae49-36266e774d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converting VIF {"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG os_vif [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92482746-fd78-5e6a-8a3d-5e0bb94305f8', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2793423f-ba, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2793423f-ba, col_values=(('qos', UUID('11f023b2-4814-4041-8bb7-15c50edeea2b')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2793423f-ba, col_values=(('external_ids', {'iface-id': '2793423f-ba0f-4844-8040-954152034998', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:a3:ba', 'vm-uuid': '6aa0fa12-4970-442d-ae49-36266e774d68'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: INFO os_vif [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba')
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-195038505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-195038505',id=18,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUYALn+Qe4bwBouHMM172AwnuDCo8Hub97tHOoN+sL0yYCQQKPRlPEZKYjt7+tYhGGAM1S+tJ0NSYwnH68UBRN5GsdSVFRHkmY5xPtQI9glZ3saVVE/aVmRO8U+qZ4/ZA==',key_name='tempest-keypair-498949403',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='246582f6f0c74a049de9e4d91f284c9b',ramdisk_id='',reservation_id='r-jlw5bbtz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-281283563',owner_user_name='tempest-TaggedAttachmentsTest-281283563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa52214955ba4f01a25e5f74699f82b4',uuid=6aa0fa12-4970-442d-ae49-36266e774d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converting VIF {"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] attach device xml: <interface type="ethernet">
Nov 16 15:23:55 user nova-compute[74658]:   <mac address="fa:16:3e:93:a3:ba"/>
Nov 16 15:23:55 user nova-compute[74658]:   <model type="virtio"/>
Nov 16 15:23:55 user nova-compute[74658]:   <mtu size="1442"/>
Nov 16 15:23:55 user nova-compute[74658]:   <target dev="tap2793423f-ba"/>
Nov 16 15:23:55 user nova-compute[74658]: </interface>
Nov 16 15:23:55 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-fece7cce-8a53-4993-9681-a55c3891e377 req-60194fe6-1a6b-411e-8438-83bfd448b194 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-plugged-2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fece7cce-8a53-4993-9681-a55c3891e377 req-60194fe6-1a6b-411e-8438-83bfd448b194 service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fece7cce-8a53-4993-9681-a55c3891e377 req-60194fe6-1a6b-411e-8438-83bfd448b194 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fece7cce-8a53-4993-9681-a55c3891e377 req-60194fe6-1a6b-411e-8438-83bfd448b194 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-fece7cce-8a53-4993-9681-a55c3891e377 req-60194fe6-1a6b-411e-8438-83bfd448b194 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-plugged-2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:55 user nova-compute[74658]: WARNING nova.compute.manager [req-fece7cce-8a53-4993-9681-a55c3891e377 req-60194fe6-1a6b-411e-8438-83bfd448b194 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received unexpected event network-vif-plugged-2793423f-ba0f-4844-8040-954152034998 for instance with vm_state active and task_state None.
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-c55c6479-586b-4f74-a2f6-4859e4e684af req-0f93cc2b-d2ad-414f-a8f3-a7f789e0fd1e service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updated VIF entry in instance network info cache for port 2793423f-ba0f-4844-8040-954152034998. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-c55c6479-586b-4f74-a2f6-4859e4e684af req-0f93cc2b-d2ad-414f-a8f3-a7f789e0fd1e service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updating instance_info_cache with network_info: [{"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c55c6479-586b-4f74-a2f6-4859e4e684af req-0f93cc2b-d2ad-414f-a8f3-a7f789e0fd1e service nova] Releasing lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] No BDM found with device name hda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] No VIF found with MAC fa:16:3e:85:76:63, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:23:55 user nova-compute[74658]:   <nova:package version="0.0.0"/>
Nov 16 15:23:55 user nova-compute[74658]:   <nova:name>tempest-device-tagging-server-195038505</nova:name>
Nov 16 15:23:55 user nova-compute[74658]:   <nova:creationTime>2023-11-16 15:23:55</nova:creationTime>
Nov 16 15:23:55 user nova-compute[74658]:   <nova:flavor name="m1.tiny">
Nov 16 15:23:55 user nova-compute[74658]:     <nova:memory>512</nova:memory>
Nov 16 15:23:55 user nova-compute[74658]:     <nova:disk>1</nova:disk>
Nov 16 15:23:55 user nova-compute[74658]:     <nova:swap>0</nova:swap>
Nov 16 15:23:55 user nova-compute[74658]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:23:55 user nova-compute[74658]:     <nova:vcpus>1</nova:vcpus>
Nov 16 15:23:55 user nova-compute[74658]:   </nova:flavor>
Nov 16 15:23:55 user nova-compute[74658]:   <nova:owner>
Nov 16 15:23:55 user nova-compute[74658]:     <nova:user uuid="aa52214955ba4f01a25e5f74699f82b4">tempest-TaggedAttachmentsTest-281283563-project-member</nova:user>
Nov 16 15:23:55 user nova-compute[74658]:     <nova:project uuid="246582f6f0c74a049de9e4d91f284c9b">tempest-TaggedAttachmentsTest-281283563</nova:project>
Nov 16 15:23:55 user nova-compute[74658]:   </nova:owner>
Nov 16 15:23:55 user nova-compute[74658]:   <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:23:55 user nova-compute[74658]:   <nova:ports>
Nov 16 15:23:55 user nova-compute[74658]:     <nova:port uuid="7835b05b-5b80-4071-9f12-34a63399f7b8">
Nov 16 15:23:55 user nova-compute[74658]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 15:23:55 user nova-compute[74658]:     </nova:port>
Nov 16 15:23:55 user nova-compute[74658]:     <nova:port uuid="2793423f-ba0f-4844-8040-954152034998">
Nov 16 15:23:55 user nova-compute[74658]:       <nova:ip type="fixed" address="10.10.10.175" ipVersion="4"/>
Nov 16 15:23:55 user nova-compute[74658]:     </nova:port>
Nov 16 15:23:55 user nova-compute[74658]:   </nova:ports>
Nov 16 15:23:55 user nova-compute[74658]: </nova:instance>
Nov 16 15:23:55 user nova-compute[74658]:  {{(pid=74658) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-640fe14f-a5cf-4c6a-befa-9076832f419a tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "interface-6aa0fa12-4970-442d-ae49-36266e774d68-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.689s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG nova.objects.instance [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lazy-loading 'flavor' on Instance uuid 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:56 user nova-compute[74658]: INFO nova.compute.manager [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Attaching volume 7183b8c8-4f36-49e3-b807-1744e4507f19 to /dev/vdb
Nov 16 15:23:56 user nova-compute[74658]: DEBUG os_brick.utils [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9c7803-020c-4742-919f-169b251f3c76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b25b62-c03e-4201-89d3-16563c8391db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48dc46a-e350-42ef-9e56-e9d00293c94f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31acd8b-019a-4e17-8110-2b1e0c9e799b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:23:56 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:23:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3808b9ad-63e0-4660-b059-3ec1f3f533e9]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG os_brick.utils [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:23:56 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updating existing volume attachment record: 62c93858-527e-40e8-b083-b6c03d690c1f {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:23:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:23:57 user nova-compute[74658]: DEBUG nova.compute.manager [req-62849188-aea4-4c75-b26e-8c138b804fd7 req-5da9234b-6134-4b28-89ad-0b4f4d25348d service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-plugged-2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:23:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-62849188-aea4-4c75-b26e-8c138b804fd7 req-5da9234b-6134-4b28-89ad-0b4f4d25348d service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-62849188-aea4-4c75-b26e-8c138b804fd7 req-5da9234b-6134-4b28-89ad-0b4f4d25348d service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-62849188-aea4-4c75-b26e-8c138b804fd7 req-5da9234b-6134-4b28-89ad-0b4f4d25348d service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:57 user nova-compute[74658]: DEBUG nova.compute.manager [req-62849188-aea4-4c75-b26e-8c138b804fd7 req-5da9234b-6134-4b28-89ad-0b4f4d25348d service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-plugged-2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:23:57 user nova-compute[74658]: WARNING nova.compute.manager [req-62849188-aea4-4c75-b26e-8c138b804fd7 req-5da9234b-6134-4b28-89ad-0b4f4d25348d service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received unexpected event network-vif-plugged-2793423f-ba0f-4844-8040-954152034998 for instance with vm_state active and task_state None.
Nov 16 15:23:58 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:23:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:23:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:23:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:23:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:23:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.346s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:23:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:23:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:23:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZTesiBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:24:01 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:24:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:24:01 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:24:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:24:01 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25faa76-6684-41bb-8434-ce0ee30bad06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:24:01 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5799834-db7f-4177-a184-689e05cf5407]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19] added
Nov 16 15:24:01 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25f8c4b-3fcc-410d-8de7-79fc3bd1deb6]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b495f9-5138-41c6-9ef1-084bb2076cf1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZTesiBM {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZTesiBM" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d8eb32-94c9-470a-bbf3-fd690815793f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fZTesiBM'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:01 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:24:01 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:24:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7687MB free_disk=25.400306701660156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[150bacb7-7098-4253-92f5-bfa259f8d583]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5c52b0-1a6c-41e7-b1c6-35e223910509]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:02 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:02 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee98ba-8564-4648-bc53-4e8ffcf8845f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19, portal: 172.16.0.220,3260]
Nov 16 15:24:02 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19, portal: 172.16.0.220,3260] successful.
Nov 16 15:24:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 03cbebbf-5414-4309-bfc1-ec0a67e09a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e06fcb99-9271-48da-ac95-3998d45e6ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 51f00d67-ae3d-4d1b-a721-280bae2e9caf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6aa0fa12-4970-442d-ae49-36266e774d68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance bf2fe627-5a1c-44f0-b872-1d4275baac59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f745b3-9b7b-48f1-8d5a-8a6841150b0a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c88d68f-b717-4647-b903-b1da1c2cf2f6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:02 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:02 user nova-compute[74658]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)
Nov 16 15:24:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:02 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:02 user nova-compute[74658]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)
Nov 16 15:24:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.666s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c312b0-ce21-41a9-8fd6-ac3dcd8181ef]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZTesiBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:24:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.699s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] <== connect_volume: return (1701ms) {'type': 'block', 'scsi_wwn': '23830626535306661', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830626535306661', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lazy-loading 'flavor' on Instance uuid 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:24:03 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:24:03 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:24:03 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:24:03 user nova-compute[74658]:   <serial>7183b8c8-4f36-49e3-b807-1744e4507f19</serial>
Nov 16 15:24:03 user nova-compute[74658]: </disk>
Nov 16 15:24:03 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] No BDM found with device name hda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] No VIF found with MAC fa:16:3e:85:76:63, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3e6d58a5-50af-46b9-9a67-9d41264174c0 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.425s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Updating instance_info_cache with network_info: [{"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-03cbebbf-5414-4309-bfc1-ec0a67e09a7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:24:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:24:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:04 user nova-compute[74658]: INFO nova.compute.manager [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Detaching volume 7183b8c8-4f36-49e3-b807-1744e4507f19
Nov 16 15:24:04 user nova-compute[74658]: INFO nova.virt.block_device [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Attempting to driver detach volume 7183b8c8-4f36-49e3-b807-1744e4507f19 from mountpoint /dev/vdb
Nov 16 15:24:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Attempting to detach device vdb from instance 6aa0fa12-4970-442d-ae49-36266e774d68 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:24:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:24:04 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:24:04 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:24:04 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:24:04 user nova-compute[74658]:   <serial>7183b8c8-4f36-49e3-b807-1744e4507f19</serial>
Nov 16 15:24:04 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 15:24:04 user nova-compute[74658]: </disk>
Nov 16 15:24:04 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:24:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Successfully detached device vdb from instance 6aa0fa12-4970-442d-ae49-36266e774d68 from the persistent domain config.
Nov 16 15:24:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6aa0fa12-4970-442d-ae49-36266e774d68 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:24:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:24:04 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:24:04 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:24:04 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:24:04 user nova-compute[74658]:   <serial>7183b8c8-4f36-49e3-b807-1744e4507f19</serial>
Nov 16 15:24:04 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 15:24:04 user nova-compute[74658]: </disk>
Nov 16 15:24:04 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:24:04 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:24:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:24:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:24:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-676f5824-c6c4-4f44-aa18-ab43787e9557 req-ec8edfcf-dde5-451f-9a3c-68fe6e54581e service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Received event network-changed-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-676f5824-c6c4-4f44-aa18-ab43787e9557 req-ec8edfcf-dde5-451f-9a3c-68fe6e54581e service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Refreshing instance network info cache due to event network-changed-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-676f5824-c6c4-4f44-aa18-ab43787e9557 req-ec8edfcf-dde5-451f-9a3c-68fe6e54581e service nova] Acquiring lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-676f5824-c6c4-4f44-aa18-ab43787e9557 req-ec8edfcf-dde5-451f-9a3c-68fe6e54581e service nova] Acquired lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG nova.network.neutron [req-676f5824-c6c4-4f44-aa18-ab43787e9557 req-ec8edfcf-dde5-451f-9a3c-68fe6e54581e service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Refreshing network info cache for port ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:15 user nova-compute[74658]: INFO nova.compute.manager [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Terminating instance
Nov 16 15:24:15 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-3ba1eea3-b0ee-4928-af73-0d9a0663dc7d req-fb182fbe-da02-4b9f-8b20-acc01f7d0680 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-unplugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3ba1eea3-b0ee-4928-af73-0d9a0663dc7d req-fb182fbe-da02-4b9f-8b20-acc01f7d0680 service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3ba1eea3-b0ee-4928-af73-0d9a0663dc7d req-fb182fbe-da02-4b9f-8b20-acc01f7d0680 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3ba1eea3-b0ee-4928-af73-0d9a0663dc7d req-fb182fbe-da02-4b9f-8b20-acc01f7d0680 service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-3ba1eea3-b0ee-4928-af73-0d9a0663dc7d req-fb182fbe-da02-4b9f-8b20-acc01f7d0680 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-unplugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:24:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-3ba1eea3-b0ee-4928-af73-0d9a0663dc7d req-fb182fbe-da02-4b9f-8b20-acc01f7d0680 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-unplugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-676f5824-c6c4-4f44-aa18-ab43787e9557 req-ec8edfcf-dde5-451f-9a3c-68fe6e54581e service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Updated VIF entry in instance network info cache for port ab836cbe-d4b9-43bc-bee5-bd37dd08ba40. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-676f5824-c6c4-4f44-aa18-ab43787e9557 req-ec8edfcf-dde5-451f-9a3c-68fe6e54581e service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Updating instance_info_cache with network_info: [{"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-676f5824-c6c4-4f44-aa18-ab43787e9557 req-ec8edfcf-dde5-451f-9a3c-68fe6e54581e service nova] Releasing lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:24:16 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Instance destroyed successfully.
Nov 16 15:24:16 user nova-compute[74658]: DEBUG nova.objects.instance [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lazy-loading 'resources' on Instance uuid e06fcb99-9271-48da-ac95-3998d45e6ccb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-228686850',display_name='tempest-ServerStableDeviceRescueTest-server-228686850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-228686850',id=4,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVunN5SWyPcwINY6srB+ewdi3nrsftWq/NkFlvGrCChZ5MlRH6RAFPYwHcXxkfPihChhmEuLuesilMmMMfBAuKVH8FxMhGNYqhemohPM52Id5BtJVMJgwtLbhP/0YxsjA==',key_name='tempest-keypair-1727289241',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:21:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d59693f6c93045eb86ae04a661060b9c',ramdisk_id='',reservation_id='r-t43gbh1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-509064368',owner_user_name='tempest-ServerStableDeviceRescueTest-509064368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ee1cb04054422e9e93a271b5b3d68f',uuid=e06fcb99-9271-48da-ac95-3998d45e6ccb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Converting VIF {"id": "a370fa54-9887-42af-b8e5-ab80c536cccd", "address": "fa:16:3e:54:3a:cb", "network": {"id": "a84e7dcd-9cee-4b29-85eb-6eb7441efd46", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-659297062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59693f6c93045eb86ae04a661060b9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa370fa54-98", "ovs_interfaceid": "a370fa54-9887-42af-b8e5-ab80c536cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:3a:cb,bridge_name='br-int',has_traffic_filtering=True,id=a370fa54-9887-42af-b8e5-ab80c536cccd,network=Network(a84e7dcd-9cee-4b29-85eb-6eb7441efd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa370fa54-98') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG os_vif [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:3a:cb,bridge_name='br-int',has_traffic_filtering=True,id=a370fa54-9887-42af-b8e5-ab80c536cccd,network=Network(a84e7dcd-9cee-4b29-85eb-6eb7441efd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa370fa54-98') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa370fa54-98, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a29a6c1f-2c1d-4f19-8a25-cfc9f51d1521) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:24:16 user nova-compute[74658]: INFO os_vif [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:3a:cb,bridge_name='br-int',has_traffic_filtering=True,id=a370fa54-9887-42af-b8e5-ab80c536cccd,network=Network(a84e7dcd-9cee-4b29-85eb-6eb7441efd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa370fa54-98')
Nov 16 15:24:16 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Deleting instance files /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb_del
Nov 16 15:24:16 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Deletion of /opt/stack/data/nova/instances/e06fcb99-9271-48da-ac95-3998d45e6ccb_del complete
Nov 16 15:24:16 user nova-compute[74658]: INFO nova.compute.manager [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 16 15:24:16 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:24:16 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:24:17 user nova-compute[74658]: INFO nova.compute.claims [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Claim successful on node user
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:24:17 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Took 0.75 seconds to deallocate network for instance.
Nov 16 15:24:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-1cd5d547-28fa-4d09-87ac-7e9e5983b09b req-4751e8fc-4422-42ee-9e90-8bcb6af46bf7 service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-deleted-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.226s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:24:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.policy [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ed5db501b2e4dcfb742e18dfdeae88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621284eebf704320bacac96aedbc77a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:24:17 user nova-compute[74658]: INFO nova.virt.block_device [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Booting with blank volume at /dev/vda
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-76a6b1c4-52c6-4e37-b04e-b57fa9edc243 req-8d394c1d-a44e-4c24-a25e-5422b2de91bb service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-76a6b1c4-52c6-4e37-b04e-b57fa9edc243 req-8d394c1d-a44e-4c24-a25e-5422b2de91bb service nova] Acquiring lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-76a6b1c4-52c6-4e37-b04e-b57fa9edc243 req-8d394c1d-a44e-4c24-a25e-5422b2de91bb service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-76a6b1c4-52c6-4e37-b04e-b57fa9edc243 req-8d394c1d-a44e-4c24-a25e-5422b2de91bb service nova] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-76a6b1c4-52c6-4e37-b04e-b57fa9edc243 req-8d394c1d-a44e-4c24-a25e-5422b2de91bb service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] No waiting events found dispatching network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:24:17 user nova-compute[74658]: WARNING nova.compute.manager [req-76a6b1c4-52c6-4e37-b04e-b57fa9edc243 req-8d394c1d-a44e-4c24-a25e-5422b2de91bb service nova] [instance: e06fcb99-9271-48da-ac95-3998d45e6ccb] Received unexpected event network-vif-plugged-a370fa54-9887-42af-b8e5-ab80c536cccd for instance with vm_state deleted and task_state None.
Nov 16 15:24:17 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Deleted allocations for instance e06fcb99-9271-48da-ac95-3998d45e6ccb
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d7c5b548-5ad3-4637-b31d-705f5cfaca67 tempest-ServerStableDeviceRescueTest-509064368 tempest-ServerStableDeviceRescueTest-509064368-project-member] Lock "e06fcb99-9271-48da-ac95-3998d45e6ccb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.473s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG nova.objects.instance [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lazy-loading 'flavor' on Instance uuid bf2fe627-5a1c-44f0-b872-1d4275baac59 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Successfully created port: 0cc3e186-3763-49fa-a75b-10a450fa6870 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:18 user nova-compute[74658]: INFO nova.compute.manager [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Attaching volume 64268fce-767c-4845-b346-ebe4b6c16004 to /dev/vdb
Nov 16 15:24:18 user nova-compute[74658]: DEBUG os_brick.utils [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6432a0ce-12c0-4e69-ad46-317ee7fec3cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c9a24f-a60e-4607-8d2d-db9d9cf8efac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1314605-ed8a-42b1-aded-52a51f46b2b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[035609fa-a2cd-4794-965f-bbb9ba9558bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:24:18 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:24:18 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dcbf76-a56d-4439-b3a6-9537a8424e31]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG os_brick.utils [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:24:18 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Updating existing volume attachment record: 8950a407-bf33-4c61-be07-8b8e72ae7e1a {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Successfully updated port: 0cc3e186-3763-49fa-a75b-10a450fa6870 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "refresh_cache-c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquired lock "refresh_cache-c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-62568f19-8659-4ccf-a2b4-7683f9a8f9c5 req-322d18bd-3ee2-4d9a-b136-7f73c77bb422 service nova] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Received event network-changed-0cc3e186-3763-49fa-a75b-10a450fa6870 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-62568f19-8659-4ccf-a2b4-7683f9a8f9c5 req-322d18bd-3ee2-4d9a-b136-7f73c77bb422 service nova] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Refreshing instance network info cache due to event network-changed-0cc3e186-3763-49fa-a75b-10a450fa6870. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-62568f19-8659-4ccf-a2b4-7683f9a8f9c5 req-322d18bd-3ee2-4d9a-b136-7f73c77bb422 service nova] Acquiring lock "refresh_cache-c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Updating instance_info_cache with network_info: [{"id": "0cc3e186-3763-49fa-a75b-10a450fa6870", "address": "fa:16:3e:74:a9:94", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc3e186-37", "ovs_interfaceid": "0cc3e186-3763-49fa-a75b-10a450fa6870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Releasing lock "refresh_cache-c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Instance network_info: |[{"id": "0cc3e186-3763-49fa-a75b-10a450fa6870", "address": "fa:16:3e:74:a9:94", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc3e186-37", "ovs_interfaceid": "0cc3e186-3763-49fa-a75b-10a450fa6870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-62568f19-8659-4ccf-a2b4-7683f9a8f9c5 req-322d18bd-3ee2-4d9a-b136-7f73c77bb422 service nova] Acquired lock "refresh_cache-c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG nova.network.neutron [req-62568f19-8659-4ccf-a2b4-7683f9a8f9c5 req-322d18bd-3ee2-4d9a-b136-7f73c77bb422 service nova] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Refreshing network info cache for port 0cc3e186-3763-49fa-a75b-10a450fa6870 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG nova.network.neutron [req-62568f19-8659-4ccf-a2b4-7683f9a8f9c5 req-322d18bd-3ee2-4d9a-b136-7f73c77bb422 service nova] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Updated VIF entry in instance network info cache for port 0cc3e186-3763-49fa-a75b-10a450fa6870. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG nova.network.neutron [req-62568f19-8659-4ccf-a2b4-7683f9a8f9c5 req-322d18bd-3ee2-4d9a-b136-7f73c77bb422 service nova] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Updating instance_info_cache with network_info: [{"id": "0cc3e186-3763-49fa-a75b-10a450fa6870", "address": "fa:16:3e:74:a9:94", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc3e186-37", "ovs_interfaceid": "0cc3e186-3763-49fa-a75b-10a450fa6870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:24:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-62568f19-8659-4ccf-a2b4-7683f9a8f9c5 req-322d18bd-3ee2-4d9a-b136-7f73c77bb422 service nova] Releasing lock "refresh_cache-c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:24:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.utils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5393dbbc-1b6f-4891-9b31-1f51f400a59a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7126dc-a085-41c1-9e46-adff53459b2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e7ca55-04ff-4462-ba5e-3082c9ae7b92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b387e069-50fd-4720-b802-f255bae73bc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:24:23 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be028b-6060-4fd0-8993-eee08f78d8e3]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.utils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Updating existing volume attachment record: 4327b0da-03ed-4d78-bdff-8a9c4f6993cf {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojdeumNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:24:23 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:24:23 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:24:23 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8e1530-ff91-47f4-ba0b-5f3f776293a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:24:23 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4871d850-a81d-4746-8ade-c44bfbdd23a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004] added
Nov 16 15:24:23 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf7736c-27e1-49e8-82ec-70d720e8f971]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a8cb63-7010-44df-acdf-bb30ffe70a63]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojdeumNg {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojdeumNg" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb2a743-c9fc-4fb7-afcb-7da3a7ba2a79]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ojdeumNg'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b13c3c-94a6-4770-9484-e53c794350fc]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[de45b8ae-6b8f-4727-987a-32b945c8675b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:24 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:24 user nova-compute[74658]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)
Nov 16 15:24:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:24 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:24 user nova-compute[74658]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)
Nov 16 15:24:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59d0b8a-9ac9-4697-a2c0-0c38fe85872b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004, portal: 172.16.0.220,3260]
Nov 16 15:24:24 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004, portal: 172.16.0.220,3260] successful.
Nov 16 15:24:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec7a279-2aaa-49dc-bdab-38d88af91218]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e844ae78-af05-4b23-8a6d-ee28d18817b1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:24 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:24 user nova-compute[74658]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)
Nov 16 15:24:24 user nova-compute[74658]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 (non-flash)
Nov 16 15:24:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:24 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:24 user nova-compute[74658]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)
Nov 16 15:24:24 user nova-compute[74658]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 (non-flash)
Nov 16 15:24:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9807c5-9a71-46d3-bbfc-37212fb76a53]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:24:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojdeumNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:25 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6aa0fa12-4970-442d-ae49-36266e774d68 is timed out.
Nov 16 15:24:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Successfully detached device vdb from instance 6aa0fa12-4970-442d-ae49-36266e774d68 from the live domain config.
Nov 16 15:24:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZTesiBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:24:25 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23738323762356233', 'path': '/dev/sdd'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738323762356233', 'path': '/dev/sdd'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.093s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG nova.objects.instance [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lazy-loading 'flavor' on Instance uuid bf2fe627-5a1c-44f0-b872-1d4275baac59 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88a44a3-d5fe-479b-8763-4d7d5f0d7a73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:24:25 user nova-compute[74658]: No targets found.
Nov 16 15:24:25 user nova-compute[74658]: iSNS:
Nov 16 15:24:25 user nova-compute[74658]: No targets found.
Nov 16 15:24:25 user nova-compute[74658]: STATIC:
Nov 16 15:24:25 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004
Nov 16 15:24:25 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:24:25 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:24:25 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:24:25 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:24:25 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:24:25 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19
Nov 16 15:24:25 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:24:25 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:24:25 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:24:25 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:24:25 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:24:25 user nova-compute[74658]: FIRMWARE:
Nov 16 15:24:25 user nova-compute[74658]: No targets found.
Nov 16 15:24:25 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:24:25 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:24:25 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:24:25 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:24:25 user nova-compute[74658]:   <source dev="/dev/sdd"/>
Nov 16 15:24:25 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:24:25 user nova-compute[74658]:   <serial>64268fce-767c-4845-b346-ebe4b6c16004</serial>
Nov 16 15:24:25 user nova-compute[74658]: </disk>
Nov 16 15:24:25 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced0b4c4-ac77-4bfe-90dd-e5b8c7ff73fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53bddf1-2f2f-4bb6-90b7-95a22aa1cab0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:25 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:25 user nova-compute[74658]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)
Nov 16 15:24:25 user nova-compute[74658]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 (non-flash)
Nov 16 15:24:25 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:25 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:25 user nova-compute[74658]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 (non-flash)
Nov 16 15:24:25 user nova-compute[74658]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 (non-flash)
Nov 16 15:24:25 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710101240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a938933b-65fa-49b5-9636-7acebbd795d0]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef66249-786c-4a1b-abeb-12ad3c8eee36]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3966899-69f0-4653-a83a-41cad2c4012c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea2b63d-5b5b-4e56-b8a7-9e7e76396c7c]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bc82c3-757f-46e9-8ec6-c7fb03930833]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2530ed-969f-4754-853e-383722cb359d]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19, portal: 172.16.0.220,3260]
Nov 16 15:24:25 user nova-compute[74658]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19, portal: 172.16.0.220,3260] successful.
Nov 16 15:24:25 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7183b8c8-4f36-49e3-b807-1744e4507f19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d09cb8b-b941-4c28-b67d-682e0b286c99]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] <== disconnect_volume: return (405ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] No VIF found with MAC fa:16:3e:0b:1e:bd, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:24:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-14ef18c4-bd34-4697-963a-c499d8ffbd13 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.512s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.volume.cinder [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Update attachment failed for attachment 4327b0da-03ed-4d78-bdff-8a9c4f6993cf. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7ff6fae1-e1e8-49bd-b407-db7a46c67c1d) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7ff6fae1-e1e8-49bd-b407-db7a46c67c1d)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7ff6fae1-e1e8-49bd-b407-db7a46c67c1d)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Traceback (most recent call last):
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     driver_block_device.attach_block_devices(
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     _log_and_attach(device)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     bdm.attach(*attach_args, **attach_kwargs)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/virt/block_device.py", line 852, in attach
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     super(DriverVolBlankBlockDevice, self).attach(
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     ret_val = method(obj, context, *args, **kwargs)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     self._do_attach(context, instance, volume, volume_api,
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     self._volume_attach(context, volume, connector, instance,
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     connection_info = volume_api.attachment_update(
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     res = method(self, ctx, *args, **kwargs)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     with excutils.save_and_reraise_exception():
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     self.force_reraise()
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     raise self.value
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     context, '3.44', skip_version_check=True).attachments.update(
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     return method.func(obj, *args, **kwargs)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     resp = self._update('/attachments/%s' % id, body)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     return self._cs_request(url, 'PUT', **kwargs)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     return self.request(url, method, **kwargs)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1]     raise exceptions.from_response(resp, body)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7ff6fae1-e1e8-49bd-b407-db7a46c67c1d)
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] 
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.compute.claims [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Aborting claim: <nova.compute.claims.Claim object at 0x7f0730464a00> {{(pid=74658) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.408s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Build of instance c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7ff6fae1-e1e8-49bd-b407-db7a46c67c1d) {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.compute.utils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Build of instance c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74658) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 16 15:24:26 user nova-compute[74658]: ERROR nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Build of instance c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7ff6fae1-e1e8-49bd-b407-db7a46c67c1d): nova.exception.BuildAbortException: Build of instance c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7ff6fae1-e1e8-49bd-b407-db7a46c67c1d)
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Unplugging VIFs for instance {{(pid=74658) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1288176307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1288176307',id=20,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621284eebf704320bacac96aedbc77a4',ramdisk_id='',reservation_id='r-krev0j2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:24:18Z,user_data=None,user_id='6ed5db501b2e4dcfb742e18dfdeae88b',uuid=c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cc3e186-3763-49fa-a75b-10a450fa6870", "address": "fa:16:3e:74:a9:94", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc3e186-37", "ovs_interfaceid": "0cc3e186-3763-49fa-a75b-10a450fa6870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converting VIF {"id": "0cc3e186-3763-49fa-a75b-10a450fa6870", "address": "fa:16:3e:74:a9:94", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc3e186-37", "ovs_interfaceid": "0cc3e186-3763-49fa-a75b-10a450fa6870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a9:94,bridge_name='br-int',has_traffic_filtering=True,id=0cc3e186-3763-49fa-a75b-10a450fa6870,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc3e186-37') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG os_vif [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a9:94,bridge_name='br-int',has_traffic_filtering=True,id=0cc3e186-3763-49fa-a75b-10a450fa6870,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc3e186-37') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cc3e186-37, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lazy-loading 'flavor' on Instance uuid 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:24:26 user nova-compute[74658]: INFO os_vif [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a9:94,bridge_name='br-int',has_traffic_filtering=True,id=0cc3e186-3763-49fa-a75b-10a450fa6870,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc3e186-37')
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Unplugged VIFs for instance {{(pid=74658) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b8d3a648-c5b1-4bbc-801c-01c59d8c3629 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.056s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:26 user nova-compute[74658]: INFO nova.compute.manager [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Detaching volume 64268fce-767c-4845-b346-ebe4b6c16004
Nov 16 15:24:27 user nova-compute[74658]: INFO nova.virt.block_device [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Attempting to driver detach volume 64268fce-767c-4845-b346-ebe4b6c16004 from mountpoint /dev/vdb
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Attempting to detach device vdb from instance bf2fe627-5a1c-44f0-b872-1d4275baac59 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:24:27 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:24:27 user nova-compute[74658]:   <source dev="/dev/sdd"/>
Nov 16 15:24:27 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:24:27 user nova-compute[74658]:   <serial>64268fce-767c-4845-b346-ebe4b6c16004</serial>
Nov 16 15:24:27 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:24:27 user nova-compute[74658]: </disk>
Nov 16 15:24:27 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:24:27 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Successfully detached device vdb from instance bf2fe627-5a1c-44f0-b872-1d4275baac59 from the persistent domain config.
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf2fe627-5a1c-44f0-b872-1d4275baac59 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:24:27 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:24:27 user nova-compute[74658]:   <source dev="/dev/sdd"/>
Nov 16 15:24:27 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:24:27 user nova-compute[74658]:   <serial>64268fce-767c-4845-b346-ebe4b6c16004</serial>
Nov 16 15:24:27 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:24:27 user nova-compute[74658]: </disk>
Nov 16 15:24:27 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:24:27 user nova-compute[74658]: INFO nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Took 0.64 seconds to deallocate network for instance.
Nov 16 15:24:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "interface-6aa0fa12-4970-442d-ae49-36266e774d68-2793423f-ba0f-4844-8040-954152034998" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "interface-6aa0fa12-4970-442d-ae49-36266e774d68-2793423f-ba0f-4844-8040-954152034998" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Detaching volume: 337a8551-2998-4b1a-8f41-db1fc45e99ee {{(pid=74658) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 16 15:24:27 user nova-compute[74658]: INFO nova.compute.manager [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Detaching volume 337a8551-2998-4b1a-8f41-db1fc45e99ee
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.objects.instance [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lazy-loading 'flavor' on Instance uuid 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-195038505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-195038505',id=18,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUYALn+Qe4bwBouHMM172AwnuDCo8Hub97tHOoN+sL0yYCQQKPRlPEZKYjt7+tYhGGAM1S+tJ0NSYwnH68UBRN5GsdSVFRHkmY5xPtQI9glZ3saVVE/aVmRO8U+qZ4/ZA==',key_name='tempest-keypair-498949403',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='246582f6f0c74a049de9e4d91f284c9b',ramdisk_id='',reservation_id='r-jlw5bbtz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-281283563',owner_user_name='tempest-TaggedAttachmentsTest-281283563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa52214955ba4f01a25e5f74699f82b4',uuid=6aa0fa12-4970-442d-ae49-36266e774d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converting VIF {"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:93:a3:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap2793423f-ba"/></interface> {{(pid=74658) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:93:a3:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap2793423f-ba"/></interface> {{(pid=74658) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Attempting to detach device tap2793423f-ba from instance 6aa0fa12-4970-442d-ae49-36266e774d68 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] detach device xml: <interface type="ethernet">
Nov 16 15:24:27 user nova-compute[74658]:   <mac address="fa:16:3e:93:a3:ba"/>
Nov 16 15:24:27 user nova-compute[74658]:   <model type="virtio"/>
Nov 16 15:24:27 user nova-compute[74658]:   <mtu size="1442"/>
Nov 16 15:24:27 user nova-compute[74658]:   <target dev="tap2793423f-ba"/>
Nov 16 15:24:27 user nova-compute[74658]: </interface>
Nov 16 15:24:27 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:93:a3:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap2793423f-ba"/></interface> {{(pid=74658) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:93:a3:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap2793423f-ba"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 16 15:24:27 user nova-compute[74658]:   <name>instance-00000012</name>
Nov 16 15:24:27 user nova-compute[74658]:   <uuid>6aa0fa12-4970-442d-ae49-36266e774d68</uuid>
Nov 16 15:24:27 user nova-compute[74658]:   <metadata>
Nov 16 15:24:27 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:24:27 user nova-compute[74658]:   <nova:package version="0.0.0"/>
Nov 16 15:24:27 user nova-compute[74658]:   <nova:name>tempest-device-tagging-server-195038505</nova:name>
Nov 16 15:24:27 user nova-compute[74658]:   <nova:creationTime>2023-11-16 15:23:55</nova:creationTime>
Nov 16 15:24:27 user nova-compute[74658]:   <nova:flavor name="m1.tiny">
Nov 16 15:24:27 user nova-compute[74658]:     <nova:memory>512</nova:memory>
Nov 16 15:24:27 user nova-compute[74658]:     <nova:disk>1</nova:disk>
Nov 16 15:24:27 user nova-compute[74658]:     <nova:swap>0</nova:swap>
Nov 16 15:24:27 user nova-compute[74658]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:24:27 user nova-compute[74658]:     <nova:vcpus>1</nova:vcpus>
Nov 16 15:24:27 user nova-compute[74658]:   </nova:flavor>
Nov 16 15:24:27 user nova-compute[74658]:   <nova:owner>
Nov 16 15:24:27 user nova-compute[74658]:     <nova:user uuid="aa52214955ba4f01a25e5f74699f82b4">tempest-TaggedAttachmentsTest-281283563-project-member</nova:user>
Nov 16 15:24:27 user nova-compute[74658]:     <nova:project uuid="246582f6f0c74a049de9e4d91f284c9b">tempest-TaggedAttachmentsTest-281283563</nova:project>
Nov 16 15:24:27 user nova-compute[74658]:   </nova:owner>
Nov 16 15:24:27 user nova-compute[74658]:   <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:24:27 user nova-compute[74658]:   <nova:ports>
Nov 16 15:24:27 user nova-compute[74658]:     <nova:port uuid="7835b05b-5b80-4071-9f12-34a63399f7b8">
Nov 16 15:24:27 user nova-compute[74658]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 15:24:27 user nova-compute[74658]:     </nova:port>
Nov 16 15:24:27 user nova-compute[74658]:     <nova:port uuid="2793423f-ba0f-4844-8040-954152034998">
Nov 16 15:24:27 user nova-compute[74658]:       <nova:ip type="fixed" address="10.10.10.175" ipVersion="4"/>
Nov 16 15:24:27 user nova-compute[74658]:     </nova:port>
Nov 16 15:24:27 user nova-compute[74658]:   </nova:ports>
Nov 16 15:24:27 user nova-compute[74658]: </nova:instance>
Nov 16 15:24:27 user nova-compute[74658]:   </metadata>
Nov 16 15:24:27 user nova-compute[74658]:   <memory unit='KiB'>524288</memory>
Nov 16 15:24:27 user nova-compute[74658]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 15:24:27 user nova-compute[74658]:   <vcpu placement='static'>1</vcpu>
Nov 16 15:24:27 user nova-compute[74658]:   <resource>
Nov 16 15:24:27 user nova-compute[74658]:     <partition>/machine</partition>
Nov 16 15:24:27 user nova-compute[74658]:   </resource>
Nov 16 15:24:27 user nova-compute[74658]:   <sysinfo type='smbios'>
Nov 16 15:24:27 user nova-compute[74658]:     <system>
Nov 16 15:24:27 user nova-compute[74658]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 15:24:27 user nova-compute[74658]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 15:24:27 user nova-compute[74658]:       <entry name='version'>0.0.0</entry>
Nov 16 15:24:27 user nova-compute[74658]:       <entry name='serial'>6aa0fa12-4970-442d-ae49-36266e774d68</entry>
Nov 16 15:24:27 user nova-compute[74658]:       <entry name='uuid'>6aa0fa12-4970-442d-ae49-36266e774d68</entry>
Nov 16 15:24:27 user nova-compute[74658]:       <entry name='family'>Virtual Machine</entry>
Nov 16 15:24:27 user nova-compute[74658]:     </system>
Nov 16 15:24:27 user nova-compute[74658]:   </sysinfo>
Nov 16 15:24:27 user nova-compute[74658]:   <os>
Nov 16 15:24:27 user nova-compute[74658]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 15:24:27 user nova-compute[74658]:     <boot dev='hd'/>
Nov 16 15:24:27 user nova-compute[74658]:     <smbios mode='sysinfo'/>
Nov 16 15:24:27 user nova-compute[74658]:   </os>
Nov 16 15:24:27 user nova-compute[74658]:   <features>
Nov 16 15:24:27 user nova-compute[74658]:     <acpi/>
Nov 16 15:24:27 user nova-compute[74658]:     <apic/>
Nov 16 15:24:27 user nova-compute[74658]:     <vmcoreinfo state='on'/>
Nov 16 15:24:27 user nova-compute[74658]:   </features>
Nov 16 15:24:27 user nova-compute[74658]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 15:24:27 user nova-compute[74658]:     <model fallback='forbid'>Nehalem</model>
Nov 16 15:24:27 user nova-compute[74658]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 15:24:27 user nova-compute[74658]:     <feature policy='require' name='vme'/>
Nov 16 15:24:27 user nova-compute[74658]:     <feature policy='require' name='x2apic'/>
Nov 16 15:24:27 user nova-compute[74658]:     <feature policy='require' name='hypervisor'/>
Nov 16 15:24:27 user nova-compute[74658]:   </cpu>
Nov 16 15:24:27 user nova-compute[74658]:   <clock offset='utc'>
Nov 16 15:24:27 user nova-compute[74658]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 15:24:27 user nova-compute[74658]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 15:24:27 user nova-compute[74658]:     <timer name='hpet' present='no'/>
Nov 16 15:24:27 user nova-compute[74658]:   </clock>
Nov 16 15:24:27 user nova-compute[74658]:   <on_poweroff>destroy</on_poweroff>
Nov 16 15:24:27 user nova-compute[74658]:   <on_reboot>restart</on_reboot>
Nov 16 15:24:27 user nova-compute[74658]:   <on_crash>destroy</on_crash>
Nov 16 15:24:27 user nova-compute[74658]:   <devices>
Nov 16 15:24:27 user nova-compute[74658]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 15:24:27 user nova-compute[74658]:     <disk type='file' device='disk'>
Nov 16 15:24:27 user nova-compute[74658]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 15:24:27 user nova-compute[74658]:       <source file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk' index='2'/>
Nov 16 15:24:27 user nova-compute[74658]:       <backingStore type='file' index='3'>
Nov 16 15:24:27 user nova-compute[74658]:         <format type='raw'/>
Nov 16 15:24:27 user nova-compute[74658]:         <source file='/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2'/>
Nov 16 15:24:27 user nova-compute[74658]:         <backingStore/>
Nov 16 15:24:27 user nova-compute[74658]:       </backingStore>
Nov 16 15:24:27 user nova-compute[74658]:       <target dev='vda' bus='virtio'/>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='virtio-disk0'/>
Nov 16 15:24:27 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </disk>
Nov 16 15:24:27 user nova-compute[74658]:     <disk type='file' device='cdrom'>
Nov 16 15:24:27 user nova-compute[74658]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 15:24:27 user nova-compute[74658]:       <source file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk.config' index='1'/>
Nov 16 15:24:27 user nova-compute[74658]:       <backingStore/>
Nov 16 15:24:27 user nova-compute[74658]:       <target dev='hda' bus='ide'/>
Nov 16 15:24:27 user nova-compute[74658]:       <readonly/>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='ide0-0-0'/>
Nov 16 15:24:27 user nova-compute[74658]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </disk>
Nov 16 15:24:27 user nova-compute[74658]:     <controller type='usb' index='0' model='none'>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='usb'/>
Nov 16 15:24:27 user nova-compute[74658]:     </controller>
Nov 16 15:24:27 user nova-compute[74658]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='pci.0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </controller>
Nov 16 15:24:27 user nova-compute[74658]:     <controller type='ide' index='0'>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='ide'/>
Nov 16 15:24:27 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 15:24:27 user nova-compute[74658]:     </controller>
Nov 16 15:24:27 user nova-compute[74658]:     <interface type='ethernet'>
Nov 16 15:24:27 user nova-compute[74658]:       <mac address='fa:16:3e:85:76:63'/>
Nov 16 15:24:27 user nova-compute[74658]:       <target dev='tap7835b05b-5b'/>
Nov 16 15:24:27 user nova-compute[74658]:       <model type='virtio'/>
Nov 16 15:24:27 user nova-compute[74658]:       <mtu size='1442'/>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='net0'/>
Nov 16 15:24:27 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </interface>
Nov 16 15:24:27 user nova-compute[74658]:     <interface type='ethernet'>
Nov 16 15:24:27 user nova-compute[74658]:       <mac address='fa:16:3e:93:a3:ba'/>
Nov 16 15:24:27 user nova-compute[74658]:       <target dev='tap2793423f-ba'/>
Nov 16 15:24:27 user nova-compute[74658]:       <model type='virtio'/>
Nov 16 15:24:27 user nova-compute[74658]:       <mtu size='1442'/>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='net1'/>
Nov 16 15:24:27 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </interface>
Nov 16 15:24:27 user nova-compute[74658]:     <serial type='pty'>
Nov 16 15:24:27 user nova-compute[74658]:       <source path='/dev/pts/8'/>
Nov 16 15:24:27 user nova-compute[74658]:       <log file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/console.log' append='off'/>
Nov 16 15:24:27 user nova-compute[74658]:       <target type='isa-serial' port='0'>
Nov 16 15:24:27 user nova-compute[74658]:         <model name='isa-serial'/>
Nov 16 15:24:27 user nova-compute[74658]:       </target>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='serial0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </serial>
Nov 16 15:24:27 user nova-compute[74658]:     <console type='pty' tty='/dev/pts/8'>
Nov 16 15:24:27 user nova-compute[74658]:       <source path='/dev/pts/8'/>
Nov 16 15:24:27 user nova-compute[74658]:       <log file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/console.log' append='off'/>
Nov 16 15:24:27 user nova-compute[74658]:       <target type='serial' port='0'/>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='serial0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </console>
Nov 16 15:24:27 user nova-compute[74658]:     <input type='mouse' bus='ps2'>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='input0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </input>
Nov 16 15:24:27 user nova-compute[74658]:     <input type='keyboard' bus='ps2'>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='input1'/>
Nov 16 15:24:27 user nova-compute[74658]:     </input>
Nov 16 15:24:27 user nova-compute[74658]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 16 15:24:27 user nova-compute[74658]:       <listen type='address' address='0.0.0.0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </graphics>
Nov 16 15:24:27 user nova-compute[74658]:     <audio id='1' type='none'/>
Nov 16 15:24:27 user nova-compute[74658]:     <video>
Nov 16 15:24:27 user nova-compute[74658]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='video0'/>
Nov 16 15:24:27 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </video>
Nov 16 15:24:27 user nova-compute[74658]:     <memballoon model='virtio'>
Nov 16 15:24:27 user nova-compute[74658]:       <stats period='10'/>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='balloon0'/>
Nov 16 15:24:27 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </memballoon>
Nov 16 15:24:27 user nova-compute[74658]:     <rng model='virtio'>
Nov 16 15:24:27 user nova-compute[74658]:       <backend model='random'>/dev/urandom</backend>
Nov 16 15:24:27 user nova-compute[74658]:       <alias name='rng0'/>
Nov 16 15:24:27 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 15:24:27 user nova-compute[74658]:     </rng>
Nov 16 15:24:27 user nova-compute[74658]:   </devices>
Nov 16 15:24:27 user nova-compute[74658]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 15:24:27 user nova-compute[74658]:     <label>libvirt-6aa0fa12-4970-442d-ae49-36266e774d68</label>
Nov 16 15:24:27 user nova-compute[74658]:     <imagelabel>libvirt-6aa0fa12-4970-442d-ae49-36266e774d68</imagelabel>
Nov 16 15:24:27 user nova-compute[74658]:   </seclabel>
Nov 16 15:24:27 user nova-compute[74658]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 15:24:27 user nova-compute[74658]:     <label>+64055:+108</label>
Nov 16 15:24:27 user nova-compute[74658]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 15:24:27 user nova-compute[74658]:   </seclabel>
Nov 16 15:24:27 user nova-compute[74658]: </domain>
Nov 16 15:24:27 user nova-compute[74658]:  {{(pid=74658) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 15:24:27 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Successfully detached device tap2793423f-ba from instance 6aa0fa12-4970-442d-ae49-36266e774d68 from the persistent domain config.
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] (1/8): Attempting to detach device tap2793423f-ba with device alias net1 from instance 6aa0fa12-4970-442d-ae49-36266e774d68 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] detach device xml: <interface type="ethernet">
Nov 16 15:24:27 user nova-compute[74658]:   <mac address="fa:16:3e:93:a3:ba"/>
Nov 16 15:24:27 user nova-compute[74658]:   <model type="virtio"/>
Nov 16 15:24:27 user nova-compute[74658]:   <mtu size="1442"/>
Nov 16 15:24:27 user nova-compute[74658]:   <target dev="tap2793423f-ba"/>
Nov 16 15:24:27 user nova-compute[74658]: </interface>
Nov 16 15:24:27 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1] Skipping driver_detach during remote rebuild. {{(pid=74658) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf2fe627-5a1c-44f0-b872-1d4275baac59 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:24:27 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Deleted allocations for instance c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1
Nov 16 15:24:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3fb20826-a59f-4ef5-85c1-12728a107340 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "c8e51b6a-1a85-4f4e-a044-2c7ce13b15e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.533s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Start waiting for the detach event from libvirt for device tap2793423f-ba with device alias net1 for instance 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.compute.manager [req-ee7a9867-3a74-4ac1-9fbc-c9f7cddc3d31 req-cdeb3a0c-54a9-4fd7-b515-f135fbf1d0c9 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-unplugged-2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ee7a9867-3a74-4ac1-9fbc-c9f7cddc3d31 req-cdeb3a0c-54a9-4fd7-b515-f135fbf1d0c9 service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ee7a9867-3a74-4ac1-9fbc-c9f7cddc3d31 req-cdeb3a0c-54a9-4fd7-b515-f135fbf1d0c9 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ee7a9867-3a74-4ac1-9fbc-c9f7cddc3d31 req-cdeb3a0c-54a9-4fd7-b515-f135fbf1d0c9 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:27 user nova-compute[74658]: DEBUG nova.compute.manager [req-ee7a9867-3a74-4ac1-9fbc-c9f7cddc3d31 req-cdeb3a0c-54a9-4fd7-b515-f135fbf1d0c9 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-unplugged-2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:24:27 user nova-compute[74658]: WARNING nova.compute.manager [req-ee7a9867-3a74-4ac1-9fbc-c9f7cddc3d31 req-cdeb3a0c-54a9-4fd7-b515-f135fbf1d0c9 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received unexpected event network-vif-unplugged-2793423f-ba0f-4844-8040-954152034998 for instance with vm_state active and task_state None.
Nov 16 15:24:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-dbd22fdc-ae7f-4cf2-a322-96102b1be1c5 req-555207a4-900c-4203-91c9-373fed12a393 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-plugged-2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:24:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dbd22fdc-ae7f-4cf2-a322-96102b1be1c5 req-555207a4-900c-4203-91c9-373fed12a393 service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dbd22fdc-ae7f-4cf2-a322-96102b1be1c5 req-555207a4-900c-4203-91c9-373fed12a393 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dbd22fdc-ae7f-4cf2-a322-96102b1be1c5 req-555207a4-900c-4203-91c9-373fed12a393 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-dbd22fdc-ae7f-4cf2-a322-96102b1be1c5 req-555207a4-900c-4203-91c9-373fed12a393 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-plugged-2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:24:29 user nova-compute[74658]: WARNING nova.compute.manager [req-dbd22fdc-ae7f-4cf2-a322-96102b1be1c5 req-555207a4-900c-4203-91c9-373fed12a393 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received unexpected event network-vif-plugged-2793423f-ba0f-4844-8040-954152034998 for instance with vm_state active and task_state None.
Nov 16 15:24:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:47 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf2fe627-5a1c-44f0-b872-1d4275baac59 is timed out.
Nov 16 15:24:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Successfully detached device vdb from instance bf2fe627-5a1c-44f0-b872-1d4275baac59 from the live domain config.
Nov 16 15:24:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojdeumNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:24:47 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4031db87-0d1e-4cde-9a15-4af154421cb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:24:47 user nova-compute[74658]: No targets found.
Nov 16 15:24:47 user nova-compute[74658]: iSNS:
Nov 16 15:24:47 user nova-compute[74658]: No targets found.
Nov 16 15:24:47 user nova-compute[74658]: STATIC:
Nov 16 15:24:47 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004
Nov 16 15:24:47 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:24:47 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:24:47 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:24:47 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:24:47 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:24:47 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:24:47 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:24:47 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:24:47 user nova-compute[74658]: FIRMWARE:
Nov 16 15:24:47 user nova-compute[74658]: No targets found.
Nov 16 15:24:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:24:47 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:24:47 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[085b10b0-652a-40a9-ba62-7d524c2cfe50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ee1af4-17d0-4b6b-ab97-f40826217c4a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:47 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:47 user nova-compute[74658]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 (non-flash)
Nov 16 15:24:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:24:47 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:24:47 user nova-compute[74658]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 (non-flash)
Nov 16 15:24:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07100fe560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004'): ({'sdd'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Removing single pathed devices sdd {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:24:47 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Waiting for libvirt event about the detach of device tap2793423f-ba with device alias net1 from instance 6aa0fa12-4970-442d-ae49-36266e774d68 is timed out.
Nov 16 15:24:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:93:a3:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap2793423f-ba"/></interface> {{(pid=74658) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:93:a3:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap2793423f-ba"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 16 15:24:47 user nova-compute[74658]:   <name>instance-00000012</name>
Nov 16 15:24:47 user nova-compute[74658]:   <uuid>6aa0fa12-4970-442d-ae49-36266e774d68</uuid>
Nov 16 15:24:47 user nova-compute[74658]:   <metadata>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:24:47 user nova-compute[74658]:   <nova:package version="0.0.0"/>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:name>tempest-device-tagging-server-195038505</nova:name>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:creationTime>2023-11-16 15:23:55</nova:creationTime>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:flavor name="m1.tiny">
Nov 16 15:24:47 user nova-compute[74658]:     <nova:memory>512</nova:memory>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:disk>1</nova:disk>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:swap>0</nova:swap>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:vcpus>1</nova:vcpus>
Nov 16 15:24:47 user nova-compute[74658]:   </nova:flavor>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:owner>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:user uuid="aa52214955ba4f01a25e5f74699f82b4">tempest-TaggedAttachmentsTest-281283563-project-member</nova:user>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:project uuid="246582f6f0c74a049de9e4d91f284c9b">tempest-TaggedAttachmentsTest-281283563</nova:project>
Nov 16 15:24:47 user nova-compute[74658]:   </nova:owner>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:ports>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:port uuid="7835b05b-5b80-4071-9f12-34a63399f7b8">
Nov 16 15:24:47 user nova-compute[74658]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 15:24:47 user nova-compute[74658]:     </nova:port>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:port uuid="2793423f-ba0f-4844-8040-954152034998">
Nov 16 15:24:47 user nova-compute[74658]:       <nova:ip type="fixed" address="10.10.10.175" ipVersion="4"/>
Nov 16 15:24:47 user nova-compute[74658]:     </nova:port>
Nov 16 15:24:47 user nova-compute[74658]:   </nova:ports>
Nov 16 15:24:47 user nova-compute[74658]: </nova:instance>
Nov 16 15:24:47 user nova-compute[74658]:   </metadata>
Nov 16 15:24:47 user nova-compute[74658]:   <memory unit='KiB'>524288</memory>
Nov 16 15:24:47 user nova-compute[74658]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 15:24:47 user nova-compute[74658]:   <vcpu placement='static'>1</vcpu>
Nov 16 15:24:47 user nova-compute[74658]:   <resource>
Nov 16 15:24:47 user nova-compute[74658]:     <partition>/machine</partition>
Nov 16 15:24:47 user nova-compute[74658]:   </resource>
Nov 16 15:24:47 user nova-compute[74658]:   <sysinfo type='smbios'>
Nov 16 15:24:47 user nova-compute[74658]:     <system>
Nov 16 15:24:47 user nova-compute[74658]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 15:24:47 user nova-compute[74658]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 15:24:47 user nova-compute[74658]:       <entry name='version'>0.0.0</entry>
Nov 16 15:24:47 user nova-compute[74658]:       <entry name='serial'>6aa0fa12-4970-442d-ae49-36266e774d68</entry>
Nov 16 15:24:47 user nova-compute[74658]:       <entry name='uuid'>6aa0fa12-4970-442d-ae49-36266e774d68</entry>
Nov 16 15:24:47 user nova-compute[74658]:       <entry name='family'>Virtual Machine</entry>
Nov 16 15:24:47 user nova-compute[74658]:     </system>
Nov 16 15:24:47 user nova-compute[74658]:   </sysinfo>
Nov 16 15:24:47 user nova-compute[74658]:   <os>
Nov 16 15:24:47 user nova-compute[74658]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 15:24:47 user nova-compute[74658]:     <boot dev='hd'/>
Nov 16 15:24:47 user nova-compute[74658]:     <smbios mode='sysinfo'/>
Nov 16 15:24:47 user nova-compute[74658]:   </os>
Nov 16 15:24:47 user nova-compute[74658]:   <features>
Nov 16 15:24:47 user nova-compute[74658]:     <acpi/>
Nov 16 15:24:47 user nova-compute[74658]:     <apic/>
Nov 16 15:24:47 user nova-compute[74658]:     <vmcoreinfo state='on'/>
Nov 16 15:24:47 user nova-compute[74658]:   </features>
Nov 16 15:24:47 user nova-compute[74658]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 15:24:47 user nova-compute[74658]:     <model fallback='forbid'>Nehalem</model>
Nov 16 15:24:47 user nova-compute[74658]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 15:24:47 user nova-compute[74658]:     <feature policy='require' name='vme'/>
Nov 16 15:24:47 user nova-compute[74658]:     <feature policy='require' name='x2apic'/>
Nov 16 15:24:47 user nova-compute[74658]:     <feature policy='require' name='hypervisor'/>
Nov 16 15:24:47 user nova-compute[74658]:   </cpu>
Nov 16 15:24:47 user nova-compute[74658]:   <clock offset='utc'>
Nov 16 15:24:47 user nova-compute[74658]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 15:24:47 user nova-compute[74658]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 15:24:47 user nova-compute[74658]:     <timer name='hpet' present='no'/>
Nov 16 15:24:47 user nova-compute[74658]:   </clock>
Nov 16 15:24:47 user nova-compute[74658]:   <on_poweroff>destroy</on_poweroff>
Nov 16 15:24:47 user nova-compute[74658]:   <on_reboot>restart</on_reboot>
Nov 16 15:24:47 user nova-compute[74658]:   <on_crash>destroy</on_crash>
Nov 16 15:24:47 user nova-compute[74658]:   <devices>
Nov 16 15:24:47 user nova-compute[74658]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 15:24:47 user nova-compute[74658]:     <disk type='file' device='disk'>
Nov 16 15:24:47 user nova-compute[74658]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 15:24:47 user nova-compute[74658]:       <source file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk' index='2'/>
Nov 16 15:24:47 user nova-compute[74658]:       <backingStore type='file' index='3'>
Nov 16 15:24:47 user nova-compute[74658]:         <format type='raw'/>
Nov 16 15:24:47 user nova-compute[74658]:         <source file='/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2'/>
Nov 16 15:24:47 user nova-compute[74658]:         <backingStore/>
Nov 16 15:24:47 user nova-compute[74658]:       </backingStore>
Nov 16 15:24:47 user nova-compute[74658]:       <target dev='vda' bus='virtio'/>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='virtio-disk0'/>
Nov 16 15:24:47 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 15:24:47 user nova-compute[74658]:     </disk>
Nov 16 15:24:47 user nova-compute[74658]:     <disk type='file' device='cdrom'>
Nov 16 15:24:47 user nova-compute[74658]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 15:24:47 user nova-compute[74658]:       <source file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk.config' index='1'/>
Nov 16 15:24:47 user nova-compute[74658]:       <backingStore/>
Nov 16 15:24:47 user nova-compute[74658]:       <target dev='hda' bus='ide'/>
Nov 16 15:24:47 user nova-compute[74658]:       <readonly/>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='ide0-0-0'/>
Nov 16 15:24:47 user nova-compute[74658]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 15:24:47 user nova-compute[74658]:     </disk>
Nov 16 15:24:47 user nova-compute[74658]:     <controller type='usb' index='0' model='none'>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='usb'/>
Nov 16 15:24:47 user nova-compute[74658]:     </controller>
Nov 16 15:24:47 user nova-compute[74658]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='pci.0'/>
Nov 16 15:24:47 user nova-compute[74658]:     </controller>
Nov 16 15:24:47 user nova-compute[74658]:     <controller type='ide' index='0'>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='ide'/>
Nov 16 15:24:47 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 15:24:47 user nova-compute[74658]:     </controller>
Nov 16 15:24:47 user nova-compute[74658]:     <interface type='ethernet'>
Nov 16 15:24:47 user nova-compute[74658]:       <mac address='fa:16:3e:85:76:63'/>
Nov 16 15:24:47 user nova-compute[74658]:       <target dev='tap7835b05b-5b'/>
Nov 16 15:24:47 user nova-compute[74658]:       <model type='virtio'/>
Nov 16 15:24:47 user nova-compute[74658]:       <mtu size='1442'/>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='net0'/>
Nov 16 15:24:47 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 15:24:47 user nova-compute[74658]:     </interface>
Nov 16 15:24:47 user nova-compute[74658]:     <serial type='pty'>
Nov 16 15:24:47 user nova-compute[74658]:       <source path='/dev/pts/8'/>
Nov 16 15:24:47 user nova-compute[74658]:       <log file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/console.log' append='off'/>
Nov 16 15:24:47 user nova-compute[74658]:       <target type='isa-serial' port='0'>
Nov 16 15:24:47 user nova-compute[74658]:         <model name='isa-serial'/>
Nov 16 15:24:47 user nova-compute[74658]:       </target>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='serial0'/>
Nov 16 15:24:47 user nova-compute[74658]:     </serial>
Nov 16 15:24:47 user nova-compute[74658]:     <console type='pty' tty='/dev/pts/8'>
Nov 16 15:24:47 user nova-compute[74658]:       <source path='/dev/pts/8'/>
Nov 16 15:24:47 user nova-compute[74658]:       <log file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/console.log' append='off'/>
Nov 16 15:24:47 user nova-compute[74658]:       <target type='serial' port='0'/>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='serial0'/>
Nov 16 15:24:47 user nova-compute[74658]:     </console>
Nov 16 15:24:47 user nova-compute[74658]:     <input type='mouse' bus='ps2'>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='input0'/>
Nov 16 15:24:47 user nova-compute[74658]:     </input>
Nov 16 15:24:47 user nova-compute[74658]:     <input type='keyboard' bus='ps2'>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='input1'/>
Nov 16 15:24:47 user nova-compute[74658]:     </input>
Nov 16 15:24:47 user nova-compute[74658]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 16 15:24:47 user nova-compute[74658]:       <listen type='address' address='0.0.0.0'/>
Nov 16 15:24:47 user nova-compute[74658]:     </graphics>
Nov 16 15:24:47 user nova-compute[74658]:     <audio id='1' type='none'/>
Nov 16 15:24:47 user nova-compute[74658]:     <video>
Nov 16 15:24:47 user nova-compute[74658]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='video0'/>
Nov 16 15:24:47 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 15:24:47 user nova-compute[74658]:     </video>
Nov 16 15:24:47 user nova-compute[74658]:     <memballoon model='virtio'>
Nov 16 15:24:47 user nova-compute[74658]:       <stats period='10'/>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='balloon0'/>
Nov 16 15:24:47 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 15:24:47 user nova-compute[74658]:     </memballoon>
Nov 16 15:24:47 user nova-compute[74658]:     <rng model='virtio'>
Nov 16 15:24:47 user nova-compute[74658]:       <backend model='random'>/dev/urandom</backend>
Nov 16 15:24:47 user nova-compute[74658]:       <alias name='rng0'/>
Nov 16 15:24:47 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 15:24:47 user nova-compute[74658]:     </rng>
Nov 16 15:24:47 user nova-compute[74658]:   </devices>
Nov 16 15:24:47 user nova-compute[74658]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 15:24:47 user nova-compute[74658]:     <label>libvirt-6aa0fa12-4970-442d-ae49-36266e774d68</label>
Nov 16 15:24:47 user nova-compute[74658]:     <imagelabel>libvirt-6aa0fa12-4970-442d-ae49-36266e774d68</imagelabel>
Nov 16 15:24:47 user nova-compute[74658]:   </seclabel>
Nov 16 15:24:47 user nova-compute[74658]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 15:24:47 user nova-compute[74658]:     <label>+64055:+108</label>
Nov 16 15:24:47 user nova-compute[74658]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 15:24:47 user nova-compute[74658]:   </seclabel>
Nov 16 15:24:47 user nova-compute[74658]: </domain>
Nov 16 15:24:47 user nova-compute[74658]:  {{(pid=74658) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 15:24:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Successfully detached device tap2793423f-ba from instance 6aa0fa12-4970-442d-ae49-36266e774d68 from the live domain config.
Nov 16 15:24:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-195038505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-195038505',id=18,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUYALn+Qe4bwBouHMM172AwnuDCo8Hub97tHOoN+sL0yYCQQKPRlPEZKYjt7+tYhGGAM1S+tJ0NSYwnH68UBRN5GsdSVFRHkmY5xPtQI9glZ3saVVE/aVmRO8U+qZ4/ZA==',key_name='tempest-keypair-498949403',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='246582f6f0c74a049de9e4d91f284c9b',ramdisk_id='',reservation_id='r-jlw5bbtz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-281283563',owner_user_name='tempest-TaggedAttachmentsTest-281283563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa52214955ba4f01a25e5f74699f82b4',uuid=6aa0fa12-4970-442d-ae49-36266e774d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converting VIF {"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_vif [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2793423f-ba, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c74559a-971d-4762-a9ee-daac37bc4af5]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11f023b2-4814-4041-8bb7-15c50edeea2b) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:24:47 user nova-compute[74658]: INFO os_vif [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba')
Nov 16 15:24:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:24:47 user nova-compute[74658]:   <nova:package version="0.0.0"/>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:name>tempest-device-tagging-server-195038505</nova:name>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:creationTime>2023-11-16 15:24:47</nova:creationTime>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:flavor name="m1.tiny">
Nov 16 15:24:47 user nova-compute[74658]:     <nova:memory>512</nova:memory>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:disk>1</nova:disk>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:swap>0</nova:swap>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:vcpus>1</nova:vcpus>
Nov 16 15:24:47 user nova-compute[74658]:   </nova:flavor>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:owner>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:user uuid="aa52214955ba4f01a25e5f74699f82b4">tempest-TaggedAttachmentsTest-281283563-project-member</nova:user>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:project uuid="246582f6f0c74a049de9e4d91f284c9b">tempest-TaggedAttachmentsTest-281283563</nova:project>
Nov 16 15:24:47 user nova-compute[74658]:   </nova:owner>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:24:47 user nova-compute[74658]:   <nova:ports>
Nov 16 15:24:47 user nova-compute[74658]:     <nova:port uuid="7835b05b-5b80-4071-9f12-34a63399f7b8">
Nov 16 15:24:47 user nova-compute[74658]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 15:24:47 user nova-compute[74658]:     </nova:port>
Nov 16 15:24:47 user nova-compute[74658]:   </nova:ports>
Nov 16 15:24:47 user nova-compute[74658]: </nova:instance>
Nov 16 15:24:47 user nova-compute[74658]:  {{(pid=74658) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed6ce3c-47f5-41e1-999d-f357912112e2]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Flushing IO for device /dev/sdd {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b90f0ba-2bb5-4172-85d4-abe6b4c4bef8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0bf15b-034a-4ba4-888f-2c0f117e4cd0]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[050ae2a6-7c76-4515-9211-f5adf91d0d48]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be72cc2-dd72-448e-9bb6-e256787cb4bb]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004, portal: 172.16.0.220,3260]
Nov 16 15:24:47 user nova-compute[74658]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004, portal: 172.16.0.220,3260] successful.
Nov 16 15:24:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64268fce-767c-4845-b346-ebe4b6c16004 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e640c856-b958-4b75-bc6c-a1205ae39833]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] <== disconnect_volume: return (379ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:24:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-deleted-2793423f-ba0f-4844-8040-954152034998 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:24:48 user nova-compute[74658]: INFO nova.compute.manager [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Neutron deleted interface 2793423f-ba0f-4844-8040-954152034998; detaching it from the instance and deleting it from the info cache
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.network.neutron [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updating instance_info_cache with network_info: [{"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquired lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.objects.instance [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] Lazy-loading 'system_metadata' on Instance uuid 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.objects.instance [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] Lazy-loading 'flavor' on Instance uuid 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.objects.base [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] Object Instance<6aa0fa12-4970-442d-ae49-36266e774d68> lazy-loaded attributes: system_metadata,flavor {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-195038505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-195038505',id=18,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUYALn+Qe4bwBouHMM172AwnuDCo8Hub97tHOoN+sL0yYCQQKPRlPEZKYjt7+tYhGGAM1S+tJ0NSYwnH68UBRN5GsdSVFRHkmY5xPtQI9glZ3saVVE/aVmRO8U+qZ4/ZA==',key_name='tempest-keypair-498949403',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='246582f6f0c74a049de9e4d91f284c9b',ramdisk_id='',reservation_id='r-jlw5bbtz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-281283563',owner_user_name='tempest-TaggedAttachmentsTest-281283563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa52214955ba4f01a25e5f74699f82b4',uuid=6aa0fa12-4970-442d-ae49-36266e774d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] Converting VIF {"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:93:a3:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap2793423f-ba"/></interface> {{(pid=74658) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:93:a3:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap2793423f-ba"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 16 15:24:48 user nova-compute[74658]:   <name>instance-00000012</name>
Nov 16 15:24:48 user nova-compute[74658]:   <uuid>6aa0fa12-4970-442d-ae49-36266e774d68</uuid>
Nov 16 15:24:48 user nova-compute[74658]:   <metadata>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:24:48 user nova-compute[74658]:   <nova:package version="0.0.0"/>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:name>tempest-device-tagging-server-195038505</nova:name>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:creationTime>2023-11-16 15:24:47</nova:creationTime>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:flavor name="m1.tiny">
Nov 16 15:24:48 user nova-compute[74658]:     <nova:memory>512</nova:memory>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:disk>1</nova:disk>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:swap>0</nova:swap>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:vcpus>1</nova:vcpus>
Nov 16 15:24:48 user nova-compute[74658]:   </nova:flavor>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:owner>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:user uuid="aa52214955ba4f01a25e5f74699f82b4">tempest-TaggedAttachmentsTest-281283563-project-member</nova:user>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:project uuid="246582f6f0c74a049de9e4d91f284c9b">tempest-TaggedAttachmentsTest-281283563</nova:project>
Nov 16 15:24:48 user nova-compute[74658]:   </nova:owner>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:ports>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:port uuid="7835b05b-5b80-4071-9f12-34a63399f7b8">
Nov 16 15:24:48 user nova-compute[74658]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 15:24:48 user nova-compute[74658]:     </nova:port>
Nov 16 15:24:48 user nova-compute[74658]:   </nova:ports>
Nov 16 15:24:48 user nova-compute[74658]: </nova:instance>
Nov 16 15:24:48 user nova-compute[74658]:   </metadata>
Nov 16 15:24:48 user nova-compute[74658]:   <memory unit='KiB'>524288</memory>
Nov 16 15:24:48 user nova-compute[74658]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 15:24:48 user nova-compute[74658]:   <vcpu placement='static'>1</vcpu>
Nov 16 15:24:48 user nova-compute[74658]:   <resource>
Nov 16 15:24:48 user nova-compute[74658]:     <partition>/machine</partition>
Nov 16 15:24:48 user nova-compute[74658]:   </resource>
Nov 16 15:24:48 user nova-compute[74658]:   <sysinfo type='smbios'>
Nov 16 15:24:48 user nova-compute[74658]:     <system>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='version'>0.0.0</entry>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='serial'>6aa0fa12-4970-442d-ae49-36266e774d68</entry>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='uuid'>6aa0fa12-4970-442d-ae49-36266e774d68</entry>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='family'>Virtual Machine</entry>
Nov 16 15:24:48 user nova-compute[74658]:     </system>
Nov 16 15:24:48 user nova-compute[74658]:   </sysinfo>
Nov 16 15:24:48 user nova-compute[74658]:   <os>
Nov 16 15:24:48 user nova-compute[74658]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 15:24:48 user nova-compute[74658]:     <boot dev='hd'/>
Nov 16 15:24:48 user nova-compute[74658]:     <smbios mode='sysinfo'/>
Nov 16 15:24:48 user nova-compute[74658]:   </os>
Nov 16 15:24:48 user nova-compute[74658]:   <features>
Nov 16 15:24:48 user nova-compute[74658]:     <acpi/>
Nov 16 15:24:48 user nova-compute[74658]:     <apic/>
Nov 16 15:24:48 user nova-compute[74658]:     <vmcoreinfo state='on'/>
Nov 16 15:24:48 user nova-compute[74658]:   </features>
Nov 16 15:24:48 user nova-compute[74658]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 15:24:48 user nova-compute[74658]:     <model fallback='forbid'>Nehalem</model>
Nov 16 15:24:48 user nova-compute[74658]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 15:24:48 user nova-compute[74658]:     <feature policy='require' name='vme'/>
Nov 16 15:24:48 user nova-compute[74658]:     <feature policy='require' name='x2apic'/>
Nov 16 15:24:48 user nova-compute[74658]:     <feature policy='require' name='hypervisor'/>
Nov 16 15:24:48 user nova-compute[74658]:   </cpu>
Nov 16 15:24:48 user nova-compute[74658]:   <clock offset='utc'>
Nov 16 15:24:48 user nova-compute[74658]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 15:24:48 user nova-compute[74658]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 15:24:48 user nova-compute[74658]:     <timer name='hpet' present='no'/>
Nov 16 15:24:48 user nova-compute[74658]:   </clock>
Nov 16 15:24:48 user nova-compute[74658]:   <on_poweroff>destroy</on_poweroff>
Nov 16 15:24:48 user nova-compute[74658]:   <on_reboot>restart</on_reboot>
Nov 16 15:24:48 user nova-compute[74658]:   <on_crash>destroy</on_crash>
Nov 16 15:24:48 user nova-compute[74658]:   <devices>
Nov 16 15:24:48 user nova-compute[74658]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 15:24:48 user nova-compute[74658]:     <disk type='file' device='disk'>
Nov 16 15:24:48 user nova-compute[74658]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 15:24:48 user nova-compute[74658]:       <source file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk' index='2'/>
Nov 16 15:24:48 user nova-compute[74658]:       <backingStore type='file' index='3'>
Nov 16 15:24:48 user nova-compute[74658]:         <format type='raw'/>
Nov 16 15:24:48 user nova-compute[74658]:         <source file='/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2'/>
Nov 16 15:24:48 user nova-compute[74658]:         <backingStore/>
Nov 16 15:24:48 user nova-compute[74658]:       </backingStore>
Nov 16 15:24:48 user nova-compute[74658]:       <target dev='vda' bus='virtio'/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='virtio-disk0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </disk>
Nov 16 15:24:48 user nova-compute[74658]:     <disk type='file' device='cdrom'>
Nov 16 15:24:48 user nova-compute[74658]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 15:24:48 user nova-compute[74658]:       <source file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk.config' index='1'/>
Nov 16 15:24:48 user nova-compute[74658]:       <backingStore/>
Nov 16 15:24:48 user nova-compute[74658]:       <target dev='hda' bus='ide'/>
Nov 16 15:24:48 user nova-compute[74658]:       <readonly/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='ide0-0-0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </disk>
Nov 16 15:24:48 user nova-compute[74658]:     <controller type='usb' index='0' model='none'>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='usb'/>
Nov 16 15:24:48 user nova-compute[74658]:     </controller>
Nov 16 15:24:48 user nova-compute[74658]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='pci.0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </controller>
Nov 16 15:24:48 user nova-compute[74658]:     <controller type='ide' index='0'>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='ide'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 15:24:48 user nova-compute[74658]:     </controller>
Nov 16 15:24:48 user nova-compute[74658]:     <interface type='ethernet'>
Nov 16 15:24:48 user nova-compute[74658]:       <mac address='fa:16:3e:85:76:63'/>
Nov 16 15:24:48 user nova-compute[74658]:       <target dev='tap7835b05b-5b'/>
Nov 16 15:24:48 user nova-compute[74658]:       <model type='virtio'/>
Nov 16 15:24:48 user nova-compute[74658]:       <mtu size='1442'/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='net0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </interface>
Nov 16 15:24:48 user nova-compute[74658]:     <serial type='pty'>
Nov 16 15:24:48 user nova-compute[74658]:       <source path='/dev/pts/8'/>
Nov 16 15:24:48 user nova-compute[74658]:       <log file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/console.log' append='off'/>
Nov 16 15:24:48 user nova-compute[74658]:       <target type='isa-serial' port='0'>
Nov 16 15:24:48 user nova-compute[74658]:         <model name='isa-serial'/>
Nov 16 15:24:48 user nova-compute[74658]:       </target>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='serial0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </serial>
Nov 16 15:24:48 user nova-compute[74658]:     <console type='pty' tty='/dev/pts/8'>
Nov 16 15:24:48 user nova-compute[74658]:       <source path='/dev/pts/8'/>
Nov 16 15:24:48 user nova-compute[74658]:       <log file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/console.log' append='off'/>
Nov 16 15:24:48 user nova-compute[74658]:       <target type='serial' port='0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='serial0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </console>
Nov 16 15:24:48 user nova-compute[74658]:     <input type='mouse' bus='ps2'>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='input0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </input>
Nov 16 15:24:48 user nova-compute[74658]:     <input type='keyboard' bus='ps2'>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='input1'/>
Nov 16 15:24:48 user nova-compute[74658]:     </input>
Nov 16 15:24:48 user nova-compute[74658]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 16 15:24:48 user nova-compute[74658]:       <listen type='address' address='0.0.0.0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </graphics>
Nov 16 15:24:48 user nova-compute[74658]:     <audio id='1' type='none'/>
Nov 16 15:24:48 user nova-compute[74658]:     <video>
Nov 16 15:24:48 user nova-compute[74658]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='video0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </video>
Nov 16 15:24:48 user nova-compute[74658]:     <memballoon model='virtio'>
Nov 16 15:24:48 user nova-compute[74658]:       <stats period='10'/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='balloon0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </memballoon>
Nov 16 15:24:48 user nova-compute[74658]:     <rng model='virtio'>
Nov 16 15:24:48 user nova-compute[74658]:       <backend model='random'>/dev/urandom</backend>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='rng0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </rng>
Nov 16 15:24:48 user nova-compute[74658]:   </devices>
Nov 16 15:24:48 user nova-compute[74658]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 15:24:48 user nova-compute[74658]:     <label>libvirt-6aa0fa12-4970-442d-ae49-36266e774d68</label>
Nov 16 15:24:48 user nova-compute[74658]:     <imagelabel>libvirt-6aa0fa12-4970-442d-ae49-36266e774d68</imagelabel>
Nov 16 15:24:48 user nova-compute[74658]:   </seclabel>
Nov 16 15:24:48 user nova-compute[74658]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 15:24:48 user nova-compute[74658]:     <label>+64055:+108</label>
Nov 16 15:24:48 user nova-compute[74658]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 15:24:48 user nova-compute[74658]:   </seclabel>
Nov 16 15:24:48 user nova-compute[74658]: </domain>
Nov 16 15:24:48 user nova-compute[74658]:  {{(pid=74658) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:93:a3:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap2793423f-ba"/></interface> {{(pid=74658) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:93:a3:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap2793423f-ba"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 16 15:24:48 user nova-compute[74658]:   <name>instance-00000012</name>
Nov 16 15:24:48 user nova-compute[74658]:   <uuid>6aa0fa12-4970-442d-ae49-36266e774d68</uuid>
Nov 16 15:24:48 user nova-compute[74658]:   <metadata>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:24:48 user nova-compute[74658]:   <nova:package version="0.0.0"/>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:name>tempest-device-tagging-server-195038505</nova:name>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:creationTime>2023-11-16 15:24:47</nova:creationTime>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:flavor name="m1.tiny">
Nov 16 15:24:48 user nova-compute[74658]:     <nova:memory>512</nova:memory>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:disk>1</nova:disk>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:swap>0</nova:swap>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:vcpus>1</nova:vcpus>
Nov 16 15:24:48 user nova-compute[74658]:   </nova:flavor>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:owner>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:user uuid="aa52214955ba4f01a25e5f74699f82b4">tempest-TaggedAttachmentsTest-281283563-project-member</nova:user>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:project uuid="246582f6f0c74a049de9e4d91f284c9b">tempest-TaggedAttachmentsTest-281283563</nova:project>
Nov 16 15:24:48 user nova-compute[74658]:   </nova:owner>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:ports>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:port uuid="7835b05b-5b80-4071-9f12-34a63399f7b8">
Nov 16 15:24:48 user nova-compute[74658]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 15:24:48 user nova-compute[74658]:     </nova:port>
Nov 16 15:24:48 user nova-compute[74658]:   </nova:ports>
Nov 16 15:24:48 user nova-compute[74658]: </nova:instance>
Nov 16 15:24:48 user nova-compute[74658]:   </metadata>
Nov 16 15:24:48 user nova-compute[74658]:   <memory unit='KiB'>524288</memory>
Nov 16 15:24:48 user nova-compute[74658]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 15:24:48 user nova-compute[74658]:   <vcpu placement='static'>1</vcpu>
Nov 16 15:24:48 user nova-compute[74658]:   <resource>
Nov 16 15:24:48 user nova-compute[74658]:     <partition>/machine</partition>
Nov 16 15:24:48 user nova-compute[74658]:   </resource>
Nov 16 15:24:48 user nova-compute[74658]:   <sysinfo type='smbios'>
Nov 16 15:24:48 user nova-compute[74658]:     <system>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='version'>0.0.0</entry>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='serial'>6aa0fa12-4970-442d-ae49-36266e774d68</entry>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='uuid'>6aa0fa12-4970-442d-ae49-36266e774d68</entry>
Nov 16 15:24:48 user nova-compute[74658]:       <entry name='family'>Virtual Machine</entry>
Nov 16 15:24:48 user nova-compute[74658]:     </system>
Nov 16 15:24:48 user nova-compute[74658]:   </sysinfo>
Nov 16 15:24:48 user nova-compute[74658]:   <os>
Nov 16 15:24:48 user nova-compute[74658]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 15:24:48 user nova-compute[74658]:     <boot dev='hd'/>
Nov 16 15:24:48 user nova-compute[74658]:     <smbios mode='sysinfo'/>
Nov 16 15:24:48 user nova-compute[74658]:   </os>
Nov 16 15:24:48 user nova-compute[74658]:   <features>
Nov 16 15:24:48 user nova-compute[74658]:     <acpi/>
Nov 16 15:24:48 user nova-compute[74658]:     <apic/>
Nov 16 15:24:48 user nova-compute[74658]:     <vmcoreinfo state='on'/>
Nov 16 15:24:48 user nova-compute[74658]:   </features>
Nov 16 15:24:48 user nova-compute[74658]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 15:24:48 user nova-compute[74658]:     <model fallback='forbid'>Nehalem</model>
Nov 16 15:24:48 user nova-compute[74658]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 15:24:48 user nova-compute[74658]:     <feature policy='require' name='vme'/>
Nov 16 15:24:48 user nova-compute[74658]:     <feature policy='require' name='x2apic'/>
Nov 16 15:24:48 user nova-compute[74658]:     <feature policy='require' name='hypervisor'/>
Nov 16 15:24:48 user nova-compute[74658]:   </cpu>
Nov 16 15:24:48 user nova-compute[74658]:   <clock offset='utc'>
Nov 16 15:24:48 user nova-compute[74658]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 15:24:48 user nova-compute[74658]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 15:24:48 user nova-compute[74658]:     <timer name='hpet' present='no'/>
Nov 16 15:24:48 user nova-compute[74658]:   </clock>
Nov 16 15:24:48 user nova-compute[74658]:   <on_poweroff>destroy</on_poweroff>
Nov 16 15:24:48 user nova-compute[74658]:   <on_reboot>restart</on_reboot>
Nov 16 15:24:48 user nova-compute[74658]:   <on_crash>destroy</on_crash>
Nov 16 15:24:48 user nova-compute[74658]:   <devices>
Nov 16 15:24:48 user nova-compute[74658]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 15:24:48 user nova-compute[74658]:     <disk type='file' device='disk'>
Nov 16 15:24:48 user nova-compute[74658]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 15:24:48 user nova-compute[74658]:       <source file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk' index='2'/>
Nov 16 15:24:48 user nova-compute[74658]:       <backingStore type='file' index='3'>
Nov 16 15:24:48 user nova-compute[74658]:         <format type='raw'/>
Nov 16 15:24:48 user nova-compute[74658]:         <source file='/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2'/>
Nov 16 15:24:48 user nova-compute[74658]:         <backingStore/>
Nov 16 15:24:48 user nova-compute[74658]:       </backingStore>
Nov 16 15:24:48 user nova-compute[74658]:       <target dev='vda' bus='virtio'/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='virtio-disk0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </disk>
Nov 16 15:24:48 user nova-compute[74658]:     <disk type='file' device='cdrom'>
Nov 16 15:24:48 user nova-compute[74658]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 15:24:48 user nova-compute[74658]:       <source file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk.config' index='1'/>
Nov 16 15:24:48 user nova-compute[74658]:       <backingStore/>
Nov 16 15:24:48 user nova-compute[74658]:       <target dev='hda' bus='ide'/>
Nov 16 15:24:48 user nova-compute[74658]:       <readonly/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='ide0-0-0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </disk>
Nov 16 15:24:48 user nova-compute[74658]:     <controller type='usb' index='0' model='none'>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='usb'/>
Nov 16 15:24:48 user nova-compute[74658]:     </controller>
Nov 16 15:24:48 user nova-compute[74658]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='pci.0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </controller>
Nov 16 15:24:48 user nova-compute[74658]:     <controller type='ide' index='0'>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='ide'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 15:24:48 user nova-compute[74658]:     </controller>
Nov 16 15:24:48 user nova-compute[74658]:     <interface type='ethernet'>
Nov 16 15:24:48 user nova-compute[74658]:       <mac address='fa:16:3e:85:76:63'/>
Nov 16 15:24:48 user nova-compute[74658]:       <target dev='tap7835b05b-5b'/>
Nov 16 15:24:48 user nova-compute[74658]:       <model type='virtio'/>
Nov 16 15:24:48 user nova-compute[74658]:       <mtu size='1442'/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='net0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </interface>
Nov 16 15:24:48 user nova-compute[74658]:     <serial type='pty'>
Nov 16 15:24:48 user nova-compute[74658]:       <source path='/dev/pts/8'/>
Nov 16 15:24:48 user nova-compute[74658]:       <log file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/console.log' append='off'/>
Nov 16 15:24:48 user nova-compute[74658]:       <target type='isa-serial' port='0'>
Nov 16 15:24:48 user nova-compute[74658]:         <model name='isa-serial'/>
Nov 16 15:24:48 user nova-compute[74658]:       </target>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='serial0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </serial>
Nov 16 15:24:48 user nova-compute[74658]:     <console type='pty' tty='/dev/pts/8'>
Nov 16 15:24:48 user nova-compute[74658]:       <source path='/dev/pts/8'/>
Nov 16 15:24:48 user nova-compute[74658]:       <log file='/opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/console.log' append='off'/>
Nov 16 15:24:48 user nova-compute[74658]:       <target type='serial' port='0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='serial0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </console>
Nov 16 15:24:48 user nova-compute[74658]:     <input type='mouse' bus='ps2'>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='input0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </input>
Nov 16 15:24:48 user nova-compute[74658]:     <input type='keyboard' bus='ps2'>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='input1'/>
Nov 16 15:24:48 user nova-compute[74658]:     </input>
Nov 16 15:24:48 user nova-compute[74658]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 16 15:24:48 user nova-compute[74658]:       <listen type='address' address='0.0.0.0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </graphics>
Nov 16 15:24:48 user nova-compute[74658]:     <audio id='1' type='none'/>
Nov 16 15:24:48 user nova-compute[74658]:     <video>
Nov 16 15:24:48 user nova-compute[74658]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='video0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </video>
Nov 16 15:24:48 user nova-compute[74658]:     <memballoon model='virtio'>
Nov 16 15:24:48 user nova-compute[74658]:       <stats period='10'/>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='balloon0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </memballoon>
Nov 16 15:24:48 user nova-compute[74658]:     <rng model='virtio'>
Nov 16 15:24:48 user nova-compute[74658]:       <backend model='random'>/dev/urandom</backend>
Nov 16 15:24:48 user nova-compute[74658]:       <alias name='rng0'/>
Nov 16 15:24:48 user nova-compute[74658]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 15:24:48 user nova-compute[74658]:     </rng>
Nov 16 15:24:48 user nova-compute[74658]:   </devices>
Nov 16 15:24:48 user nova-compute[74658]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 15:24:48 user nova-compute[74658]:     <label>libvirt-6aa0fa12-4970-442d-ae49-36266e774d68</label>
Nov 16 15:24:48 user nova-compute[74658]:     <imagelabel>libvirt-6aa0fa12-4970-442d-ae49-36266e774d68</imagelabel>
Nov 16 15:24:48 user nova-compute[74658]:   </seclabel>
Nov 16 15:24:48 user nova-compute[74658]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 15:24:48 user nova-compute[74658]:     <label>+64055:+108</label>
Nov 16 15:24:48 user nova-compute[74658]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 15:24:48 user nova-compute[74658]:   </seclabel>
Nov 16 15:24:48 user nova-compute[74658]: </domain>
Nov 16 15:24:48 user nova-compute[74658]:  {{(pid=74658) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 15:24:48 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Detaching interface fa:16:3e:93:a3:ba failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2793423f-ba' not found.
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-195038505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-195038505',id=18,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUYALn+Qe4bwBouHMM172AwnuDCo8Hub97tHOoN+sL0yYCQQKPRlPEZKYjt7+tYhGGAM1S+tJ0NSYwnH68UBRN5GsdSVFRHkmY5xPtQI9glZ3saVVE/aVmRO8U+qZ4/ZA==',key_name='tempest-keypair-498949403',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='246582f6f0c74a049de9e4d91f284c9b',ramdisk_id='',reservation_id='r-jlw5bbtz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-281283563',owner_user_name='tempest-TaggedAttachmentsTest-281283563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa52214955ba4f01a25e5f74699f82b4',uuid=6aa0fa12-4970-442d-ae49-36266e774d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] Converting VIF {"id": "2793423f-ba0f-4844-8040-954152034998", "address": "fa:16:3e:93:a3:ba", "network": {"id": "8a19378c-12cc-41b5-a243-0139d9925292", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2003425454", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2793423f-ba", "ovs_interfaceid": "2793423f-ba0f-4844-8040-954152034998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG os_vif [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2793423f-ba, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:24:48 user nova-compute[74658]: INFO os_vif [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:a3:ba,bridge_name='br-int',has_traffic_filtering=True,id=2793423f-ba0f-4844-8040-954152034998,network=Network(8a19378c-12cc-41b5-a243-0139d9925292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2793423f-ba')
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [req-4d3bf3c9-3631-44aa-b686-2d4cb7c44943 req-8286fd55-0ea0-419f-8d08-cbd8e689c18d service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:24:48 user nova-compute[74658]:   <nova:package version="0.0.0"/>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:name>tempest-device-tagging-server-195038505</nova:name>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:creationTime>2023-11-16 15:24:48</nova:creationTime>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:flavor name="m1.tiny">
Nov 16 15:24:48 user nova-compute[74658]:     <nova:memory>512</nova:memory>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:disk>1</nova:disk>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:swap>0</nova:swap>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:vcpus>1</nova:vcpus>
Nov 16 15:24:48 user nova-compute[74658]:   </nova:flavor>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:owner>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:user uuid="aa52214955ba4f01a25e5f74699f82b4">tempest-TaggedAttachmentsTest-281283563-project-member</nova:user>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:project uuid="246582f6f0c74a049de9e4d91f284c9b">tempest-TaggedAttachmentsTest-281283563</nova:project>
Nov 16 15:24:48 user nova-compute[74658]:   </nova:owner>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:24:48 user nova-compute[74658]:   <nova:ports>
Nov 16 15:24:48 user nova-compute[74658]:     <nova:port uuid="7835b05b-5b80-4071-9f12-34a63399f7b8">
Nov 16 15:24:48 user nova-compute[74658]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 15:24:48 user nova-compute[74658]:     </nova:port>
Nov 16 15:24:48 user nova-compute[74658]:   </nova:ports>
Nov 16 15:24:48 user nova-compute[74658]: </nova:instance>
Nov 16 15:24:48 user nova-compute[74658]:  {{(pid=74658) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.objects.instance [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lazy-loading 'flavor' on Instance uuid bf2fe627-5a1c-44f0-b872-1d4275baac59 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4c2a3c9d-13a5-4108-9665-b63b0c69b021 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.831s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG nova.network.neutron [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updating instance_info_cache with network_info: [{"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:24:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Releasing lock "refresh_cache-6aa0fa12-4970-442d-ae49-36266e774d68" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:24:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f4be6ec0-2a5b-4660-88f7-47d6ce79b138 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "interface-6aa0fa12-4970-442d-ae49-36266e774d68-2793423f-ba0f-4844-8040-954152034998" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.784s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:55 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:24:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:24:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:24:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:24:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:24:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:01 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:01 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8071MB free_disk=25.50275421142578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 03cbebbf-5414-4309-bfc1-ec0a67e09a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 51f00d67-ae3d-4d1b-a721-280bae2e9caf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6aa0fa12-4970-442d-ae49-36266e774d68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance bf2fe627-5a1c-44f0-b872-1d4275baac59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:25:01 user nova-compute[74658]: INFO nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6c8dd806-c294-40dd-a13d-63659a1d5669 has allocations against this compute host but is not found in the database.
Nov 16 15:25:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:25:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.099s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:25:02 user nova-compute[74658]: INFO nova.compute.claims [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Claim successful on node user
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:25:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:25:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:25:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Creating image(s)
Nov 16 15:25:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "/opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "/opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:02 user nova-compute[74658]: DEBUG nova.policy [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f04b6f7159cc4358a2978e9c97aa2dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634ad79271c9408da094067dd3c209d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.204s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.197s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk 1073741824" returned: 0 in 0.057s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Successfully created port: add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Cannot resize image /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Ensure instance console log exists: /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating instance_info_cache with network_info: [{"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-51f00d67-ae3d-4d1b-a721-280bae2e9caf" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:25:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Successfully updated port: add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquired lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-077235dd-bbb3-48a1-a31f-dad8ab984efa req-52827e63-38fa-402c-b4db-4357748fecfd service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-changed-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-077235dd-bbb3-48a1-a31f-dad8ab984efa req-52827e63-38fa-402c-b4db-4357748fecfd service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Refreshing instance network info cache due to event network-changed-add946f4-de44-48b9-9de4-3c76c1d1c8ae. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-077235dd-bbb3-48a1-a31f-dad8ab984efa req-52827e63-38fa-402c-b4db-4357748fecfd service nova] Acquiring lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updating instance_info_cache with network_info: [{"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Releasing lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance network_info: |[{"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-077235dd-bbb3-48a1-a31f-dad8ab984efa req-52827e63-38fa-402c-b4db-4357748fecfd service nova] Acquired lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.network.neutron [req-077235dd-bbb3-48a1-a31f-dad8ab984efa req-52827e63-38fa-402c-b4db-4357748fecfd service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Refreshing network info cache for port add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Start _get_guest_xml network_info=[{"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:25:04 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:04 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-855420044',display_name='tempest-AttachVolumeTestJSON-server-855420044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-855420044',id=21,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0aQzQPL9O0sCZYH1ntlAkbDeS1BfXalYyPNg5mzbOT3rQ3DQzwLD0COpv3rF6yI3D5ElP0hp1r6opeP6BA0IQrQD2St0Ieh9euvcCJptTl1EjscoAuo3T+KfsTBHg0uQ==',key_name='tempest-keypair-2113042845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-rfy50ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=6c8dd806-c294-40dd-a13d-63659a1d5669,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:25:04 user nova-compute[74658]:   <uuid>6c8dd806-c294-40dd-a13d-63659a1d5669</uuid>
Nov 16 15:25:04 user nova-compute[74658]:   <name>instance-00000015</name>
Nov 16 15:25:04 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:25:04 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:25:04 user nova-compute[74658]:   <metadata>
Nov 16 15:25:04 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:25:04 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:25:04 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeTestJSON-server-855420044</nova:name>
Nov 16 15:25:04 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:25:04</nova:creationTime>
Nov 16 15:25:04 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:25:04 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:25:04 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:25:04 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:25:04 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:25:04 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:25:04 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:25:04 user nova-compute[74658]:       <nova:owner>
Nov 16 15:25:04 user nova-compute[74658]:         <nova:user uuid="f04b6f7159cc4358a2978e9c97aa2dfc">tempest-AttachVolumeTestJSON-1830126630-project-member</nova:user>
Nov 16 15:25:04 user nova-compute[74658]:         <nova:project uuid="634ad79271c9408da094067dd3c209d7">tempest-AttachVolumeTestJSON-1830126630</nova:project>
Nov 16 15:25:04 user nova-compute[74658]:       </nova:owner>
Nov 16 15:25:04 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:25:04 user nova-compute[74658]:       <nova:ports>
Nov 16 15:25:04 user nova-compute[74658]:         <nova:port uuid="add946f4-de44-48b9-9de4-3c76c1d1c8ae">
Nov 16 15:25:04 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 15:25:04 user nova-compute[74658]:         </nova:port>
Nov 16 15:25:04 user nova-compute[74658]:       </nova:ports>
Nov 16 15:25:04 user nova-compute[74658]:     </nova:instance>
Nov 16 15:25:04 user nova-compute[74658]:   </metadata>
Nov 16 15:25:04 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:25:04 user nova-compute[74658]:     <system>
Nov 16 15:25:04 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:25:04 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:25:04 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:25:04 user nova-compute[74658]:       <entry name="serial">6c8dd806-c294-40dd-a13d-63659a1d5669</entry>
Nov 16 15:25:04 user nova-compute[74658]:       <entry name="uuid">6c8dd806-c294-40dd-a13d-63659a1d5669</entry>
Nov 16 15:25:04 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:25:04 user nova-compute[74658]:     </system>
Nov 16 15:25:04 user nova-compute[74658]:   </sysinfo>
Nov 16 15:25:04 user nova-compute[74658]:   <os>
Nov 16 15:25:04 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:25:04 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:25:04 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:25:04 user nova-compute[74658]:   </os>
Nov 16 15:25:04 user nova-compute[74658]:   <features>
Nov 16 15:25:04 user nova-compute[74658]:     <acpi/>
Nov 16 15:25:04 user nova-compute[74658]:     <apic/>
Nov 16 15:25:04 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:25:04 user nova-compute[74658]:   </features>
Nov 16 15:25:04 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:25:04 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:25:04 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:25:04 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:25:04 user nova-compute[74658]:   </clock>
Nov 16 15:25:04 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:25:04 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:25:04 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:25:04 user nova-compute[74658]:   </cpu>
Nov 16 15:25:04 user nova-compute[74658]:   <devices>
Nov 16 15:25:04 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:25:04 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:25:04 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk"/>
Nov 16 15:25:04 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:25:04 user nova-compute[74658]:     </disk>
Nov 16 15:25:04 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:25:04 user nova-compute[74658]:       <mac address="fa:16:3e:f1:80:2c"/>
Nov 16 15:25:04 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:25:04 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:25:04 user nova-compute[74658]:       <target dev="tapadd946f4-de"/>
Nov 16 15:25:04 user nova-compute[74658]:     </interface>
Nov 16 15:25:04 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:25:04 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/console.log" append="off"/>
Nov 16 15:25:04 user nova-compute[74658]:     </serial>
Nov 16 15:25:04 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:25:04 user nova-compute[74658]:     <video>
Nov 16 15:25:04 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:25:04 user nova-compute[74658]:     </video>
Nov 16 15:25:04 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:25:04 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:25:04 user nova-compute[74658]:     </rng>
Nov 16 15:25:04 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:25:04 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:25:04 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:25:04 user nova-compute[74658]:     </memballoon>
Nov 16 15:25:04 user nova-compute[74658]:   </devices>
Nov 16 15:25:04 user nova-compute[74658]: </domain>
Nov 16 15:25:04 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-855420044',display_name='tempest-AttachVolumeTestJSON-server-855420044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-855420044',id=21,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0aQzQPL9O0sCZYH1ntlAkbDeS1BfXalYyPNg5mzbOT3rQ3DQzwLD0COpv3rF6yI3D5ElP0hp1r6opeP6BA0IQrQD2St0Ieh9euvcCJptTl1EjscoAuo3T+KfsTBHg0uQ==',key_name='tempest-keypair-2113042845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-rfy50ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=6c8dd806-c294-40dd-a13d-63659a1d5669,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG os_vif [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1187be47-9485-5392-b79b-0f1793077c8d', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadd946f4-de, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadd946f4-de, col_values=(('qos', UUID('cb219db9-9653-4a7d-9ace-66a59fad3440')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadd946f4-de, col_values=(('external_ids', {'iface-id': 'add946f4-de44-48b9-9de4-3c76c1d1c8ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:80:2c', 'vm-uuid': '6c8dd806-c294-40dd-a13d-63659a1d5669'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:04 user nova-compute[74658]: INFO os_vif [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de')
Nov 16 15:25:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "e7150393-ff50-4c0a-a904-4e4486925bb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No VIF found with MAC fa:16:3e:f1:80:2c, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:25:05 user nova-compute[74658]: INFO nova.compute.claims [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Claim successful on node user
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.network.neutron [req-077235dd-bbb3-48a1-a31f-dad8ab984efa req-52827e63-38fa-402c-b4db-4357748fecfd service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updated VIF entry in instance network info cache for port add946f4-de44-48b9-9de4-3c76c1d1c8ae. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.network.neutron [req-077235dd-bbb3-48a1-a31f-dad8ab984efa req-52827e63-38fa-402c-b4db-4357748fecfd service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updating instance_info_cache with network_info: [{"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-077235dd-bbb3-48a1-a31f-dad8ab984efa req-52827e63-38fa-402c-b4db-4357748fecfd service nova] Releasing lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:25:05 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:25:05 user nova-compute[74658]: INFO nova.virt.block_device [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Booting with volume snapshot 72f5beaa-b44f-4693-9234-b8375bffa0ab at /dev/vda
Nov 16 15:25:05 user nova-compute[74658]: DEBUG nova.policy [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aed7ea9505b3400ebbe1ce456419bc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2156886e7c2247e38a1ffe4025798a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:25:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:06 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Successfully created port: 9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:25:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Successfully updated port: 9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "refresh_cache-e7150393-ff50-4c0a-a904-4e4486925bb9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquired lock "refresh_cache-e7150393-ff50-4c0a-a904-4e4486925bb9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-b24cb0aa-2392-4e4b-91c0-cf6e5e9f358f req-a85dbcb6-dbe6-4985-9acb-8d87ecda4971 service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Received event network-changed-9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-b24cb0aa-2392-4e4b-91c0-cf6e5e9f358f req-a85dbcb6-dbe6-4985-9acb-8d87ecda4971 service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Refreshing instance network info cache due to event network-changed-9b91b137-0a00-4ec5-960c-908ca38f9dc9. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b24cb0aa-2392-4e4b-91c0-cf6e5e9f358f req-a85dbcb6-dbe6-4985-9acb-8d87ecda4971 service nova] Acquiring lock "refresh_cache-e7150393-ff50-4c0a-a904-4e4486925bb9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Updating instance_info_cache with network_info: [{"id": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "address": "fa:16:3e:18:c9:56", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b91b137-0a", "ovs_interfaceid": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Releasing lock "refresh_cache-e7150393-ff50-4c0a-a904-4e4486925bb9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Instance network_info: |[{"id": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "address": "fa:16:3e:18:c9:56", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b91b137-0a", "ovs_interfaceid": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b24cb0aa-2392-4e4b-91c0-cf6e5e9f358f req-a85dbcb6-dbe6-4985-9acb-8d87ecda4971 service nova] Acquired lock "refresh_cache-e7150393-ff50-4c0a-a904-4e4486925bb9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:07 user nova-compute[74658]: DEBUG nova.network.neutron [req-b24cb0aa-2392-4e4b-91c0-cf6e5e9f358f req-a85dbcb6-dbe6-4985-9acb-8d87ecda4971 service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Refreshing network info cache for port 9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:25:08 user nova-compute[74658]: INFO nova.compute.claims [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Claim successful on node user
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.network.neutron [req-b24cb0aa-2392-4e4b-91c0-cf6e5e9f358f req-a85dbcb6-dbe6-4985-9acb-8d87ecda4971 service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Updated VIF entry in instance network info cache for port 9b91b137-0a00-4ec5-960c-908ca38f9dc9. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.network.neutron [req-b24cb0aa-2392-4e4b-91c0-cf6e5e9f358f req-a85dbcb6-dbe6-4985-9acb-8d87ecda4971 service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Updating instance_info_cache with network_info: [{"id": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "address": "fa:16:3e:18:c9:56", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b91b137-0a", "ovs_interfaceid": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b24cb0aa-2392-4e4b-91c0-cf6e5e9f358f req-a85dbcb6-dbe6-4985-9acb-8d87ecda4971 service nova] Releasing lock "refresh_cache-e7150393-ff50-4c0a-a904-4e4486925bb9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:25:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:25:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance spawned successfully.
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.policy [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3cee7d0742148a1808713d978dbd01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08549dcd4d26408098316f61ca4a6ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:25:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Creating image(s)
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "/opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "/opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "/opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "4946f418f2ef3366aed0cb46203973ab82f3e746" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "4946f418f2ef3366aed0cb46203973ab82f3e746" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:08 user nova-compute[74658]: INFO nova.compute.manager [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "97135af5-e020-482b-a54b-6cf30a5443d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "97135af5-e020-482b-a54b-6cf30a5443d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:25:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746.part --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:09 user nova-compute[74658]: INFO nova.compute.manager [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Took 7.56 seconds to build instance.
Nov 16 15:25:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1304ae8b-c2e6-4d86-9e5d-b1c7fdd2c6e8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.671s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:25:09 user nova-compute[74658]: INFO nova.compute.claims [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Claim successful on node user
Nov 16 15:25:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Successfully created port: d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:25:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746.part --force-share --output=json" returned: 0 in 0.247s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:09 user nova-compute[74658]: DEBUG nova.virt.images [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] 3dfb8e0c-e009-4134-8758-6224175b38b4 was qcow2, converting to raw {{(pid=74658) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 15:25:09 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:25:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746.part /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746.converted {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746.part /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746.converted" returned: 0 in 0.235s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746.converted --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "4946f418f2ef3366aed0cb46203973ab82f3e746" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.259s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.724s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Successfully updated port: d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:25:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquired lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746 --force-share --output=json" returned: 0 in 0.230s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "4946f418f2ef3366aed0cb46203973ab82f3e746" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "4946f418f2ef3366aed0cb46203973ab82f3e746" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-f0a868f4-17ed-4b73-a08f-05c2e45a1ddd req-262f4db7-e51c-4531-980d-c7009f248684 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-changed-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-f0a868f4-17ed-4b73-a08f-05c2e45a1ddd req-262f4db7-e51c-4531-980d-c7009f248684 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Refreshing instance network info cache due to event network-changed-d74fbdec-d4bb-4577-bcdc-5eec41374f07. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f0a868f4-17ed-4b73-a08f-05c2e45a1ddd req-262f4db7-e51c-4531-980d-c7009f248684 service nova] Acquiring lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.policy [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ed5db501b2e4dcfb742e18dfdeae88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621284eebf704320bacac96aedbc77a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:25:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Creating image(s)
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "/opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "/opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "/opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.049s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746 --force-share --output=json" returned: 0 in 0.265s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746,backing_fmt=raw /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746,backing_fmt=raw /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk 1073741824" returned: 0 in 0.100s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "4946f418f2ef3366aed0cb46203973ab82f3e746" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updating instance_info_cache with network_info: [{"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Releasing lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Instance network_info: |[{"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f0a868f4-17ed-4b73-a08f-05c2e45a1ddd req-262f4db7-e51c-4531-980d-c7009f248684 service nova] Acquired lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.network.neutron [req-f0a868f4-17ed-4b73-a08f-05c2e45a1ddd req-262f4db7-e51c-4531-980d-c7009f248684 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Refreshing network info cache for port d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746 --force-share --output=json" returned: 0 in 0.230s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:25:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.214s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Successfully created port: f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk 1073741824" returned: 0 in 0.061s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Cannot resize image /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Ensure instance console log exists: /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Start _get_guest_xml network_info=[{"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:25:05Z,direct_url=<?>,disk_format='qcow2',id=3dfb8e0c-e009-4134-8758-6224175b38b4,min_disk=0,min_ram=0,name='tempest-scenario-img--234210129',owner='08549dcd4d26408098316f61ca4a6ee2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:25:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': '3dfb8e0c-e009-4134-8758-6224175b38b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:25:11 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:11 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:25:05Z,direct_url=<?>,disk_format='qcow2',id=3dfb8e0c-e009-4134-8758-6224175b38b4,min_disk=0,min_ram=0,name='tempest-scenario-img--234210129',owner='08549dcd4d26408098316f61ca4a6ee2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:25:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-815061819',display_name='tempest-TestMinimumBasicScenario-server-815061819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-815061819',id=23,image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdwvlnLLIm4nJfBEVS4gU9R+vVTf4AEKUWi4rXQcAbDUIvgksBJbbhGBylBHQTlNxwB5nPvGuYyloQbvUQheXMF4p00cira0X+myTFfLY/1UOCBmylgAYJ1qofW+bztkw==',key_name='tempest-TestMinimumBasicScenario-1953655943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08549dcd4d26408098316f61ca4a6ee2',ramdisk_id='',reservation_id='r-nk6dncr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1910079629',owner_user_name='tempest-TestMinimumBasicScenario-1910079629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:25:09Z,user_data=None,user_id='d3cee7d0742148a1808713d978dbd01b',uuid=38ff00d1-ed55-4b2e-8578-7d23241b14ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converting VIF {"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.objects.instance [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'pci_devices' on Instance uuid 38ff00d1-ed55-4b2e-8578-7d23241b14ae {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.204s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:25:11 user nova-compute[74658]:   <uuid>38ff00d1-ed55-4b2e-8578-7d23241b14ae</uuid>
Nov 16 15:25:11 user nova-compute[74658]:   <name>instance-00000017</name>
Nov 16 15:25:11 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:25:11 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:25:11 user nova-compute[74658]:   <metadata>
Nov 16 15:25:11 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:25:11 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:25:11 user nova-compute[74658]:       <nova:name>tempest-TestMinimumBasicScenario-server-815061819</nova:name>
Nov 16 15:25:11 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:25:11</nova:creationTime>
Nov 16 15:25:11 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:25:11 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:25:11 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:25:11 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:25:11 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:25:11 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:25:11 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:25:11 user nova-compute[74658]:       <nova:owner>
Nov 16 15:25:11 user nova-compute[74658]:         <nova:user uuid="d3cee7d0742148a1808713d978dbd01b">tempest-TestMinimumBasicScenario-1910079629-project-member</nova:user>
Nov 16 15:25:11 user nova-compute[74658]:         <nova:project uuid="08549dcd4d26408098316f61ca4a6ee2">tempest-TestMinimumBasicScenario-1910079629</nova:project>
Nov 16 15:25:11 user nova-compute[74658]:       </nova:owner>
Nov 16 15:25:11 user nova-compute[74658]:       <nova:root type="image" uuid="3dfb8e0c-e009-4134-8758-6224175b38b4"/>
Nov 16 15:25:11 user nova-compute[74658]:       <nova:ports>
Nov 16 15:25:11 user nova-compute[74658]:         <nova:port uuid="d74fbdec-d4bb-4577-bcdc-5eec41374f07">
Nov 16 15:25:11 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 15:25:11 user nova-compute[74658]:         </nova:port>
Nov 16 15:25:11 user nova-compute[74658]:       </nova:ports>
Nov 16 15:25:11 user nova-compute[74658]:     </nova:instance>
Nov 16 15:25:11 user nova-compute[74658]:   </metadata>
Nov 16 15:25:11 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:25:11 user nova-compute[74658]:     <system>
Nov 16 15:25:11 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:25:11 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:25:11 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:25:11 user nova-compute[74658]:       <entry name="serial">38ff00d1-ed55-4b2e-8578-7d23241b14ae</entry>
Nov 16 15:25:11 user nova-compute[74658]:       <entry name="uuid">38ff00d1-ed55-4b2e-8578-7d23241b14ae</entry>
Nov 16 15:25:11 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:25:11 user nova-compute[74658]:     </system>
Nov 16 15:25:11 user nova-compute[74658]:   </sysinfo>
Nov 16 15:25:11 user nova-compute[74658]:   <os>
Nov 16 15:25:11 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:25:11 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:25:11 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:25:11 user nova-compute[74658]:   </os>
Nov 16 15:25:11 user nova-compute[74658]:   <features>
Nov 16 15:25:11 user nova-compute[74658]:     <acpi/>
Nov 16 15:25:11 user nova-compute[74658]:     <apic/>
Nov 16 15:25:11 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:25:11 user nova-compute[74658]:   </features>
Nov 16 15:25:11 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:25:11 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:25:11 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:25:11 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:25:11 user nova-compute[74658]:   </clock>
Nov 16 15:25:11 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:25:11 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:25:11 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:25:11 user nova-compute[74658]:   </cpu>
Nov 16 15:25:11 user nova-compute[74658]:   <devices>
Nov 16 15:25:11 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:25:11 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:25:11 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk"/>
Nov 16 15:25:11 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:25:11 user nova-compute[74658]:     </disk>
Nov 16 15:25:11 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:25:11 user nova-compute[74658]:       <mac address="fa:16:3e:48:94:b9"/>
Nov 16 15:25:11 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:25:11 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:25:11 user nova-compute[74658]:       <target dev="tapd74fbdec-d4"/>
Nov 16 15:25:11 user nova-compute[74658]:     </interface>
Nov 16 15:25:11 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:25:11 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/console.log" append="off"/>
Nov 16 15:25:11 user nova-compute[74658]:     </serial>
Nov 16 15:25:11 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:25:11 user nova-compute[74658]:     <video>
Nov 16 15:25:11 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:25:11 user nova-compute[74658]:     </video>
Nov 16 15:25:11 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:25:11 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:25:11 user nova-compute[74658]:     </rng>
Nov 16 15:25:11 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:25:11 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:25:11 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:25:11 user nova-compute[74658]:     </memballoon>
Nov 16 15:25:11 user nova-compute[74658]:   </devices>
Nov 16 15:25:11 user nova-compute[74658]: </domain>
Nov 16 15:25:11 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-815061819',display_name='tempest-TestMinimumBasicScenario-server-815061819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-815061819',id=23,image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdwvlnLLIm4nJfBEVS4gU9R+vVTf4AEKUWi4rXQcAbDUIvgksBJbbhGBylBHQTlNxwB5nPvGuYyloQbvUQheXMF4p00cira0X+myTFfLY/1UOCBmylgAYJ1qofW+bztkw==',key_name='tempest-TestMinimumBasicScenario-1953655943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08549dcd4d26408098316f61ca4a6ee2',ramdisk_id='',reservation_id='r-nk6dncr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1910079629',owner_user_name='tempest-TestMinimumBasicScenario-1910079629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:25:09Z,user_data=None,user_id='d3cee7d0742148a1808713d978dbd01b',uuid=38ff00d1-ed55-4b2e-8578-7d23241b14ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converting VIF {"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG os_vif [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '710ab8ce-a7b8-5cd4-ab74-d420c39fc90a', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd74fbdec-d4, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd74fbdec-d4, col_values=(('qos', UUID('d448c093-060b-4942-ab56-0cf03e5ae1e6')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd74fbdec-d4, col_values=(('external_ids', {'iface-id': 'd74fbdec-d4bb-4577-bcdc-5eec41374f07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:94:b9', 'vm-uuid': '38ff00d1-ed55-4b2e-8578-7d23241b14ae'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:11 user nova-compute[74658]: INFO os_vif [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4')
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.network.neutron [req-f0a868f4-17ed-4b73-a08f-05c2e45a1ddd req-262f4db7-e51c-4531-980d-c7009f248684 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updated VIF entry in instance network info cache for port d74fbdec-d4bb-4577-bcdc-5eec41374f07. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.network.neutron [req-f0a868f4-17ed-4b73-a08f-05c2e45a1ddd req-262f4db7-e51c-4531-980d-c7009f248684 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updating instance_info_cache with network_info: [{"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f0a868f4-17ed-4b73-a08f-05c2e45a1ddd req-262f4db7-e51c-4531-980d-c7009f248684 service nova] Releasing lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Cannot resize image /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Ensure instance console log exists: /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] No VIF found with MAC fa:16:3e:48:94:b9, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG os_brick.utils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3af9b3-460f-480a-b5f9-1f80004660e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85c5794-d2f6-45f4-82e2-540bd6e41d24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a217a40-0ca8-4a16-8faf-fa73eca50bb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bada091-d453-4cc6-a5af-4a7f684047b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:25:11 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e19f39-ac0a-4dbb-9a81-e5f84931ac1a]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG os_brick.utils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Updating existing volume attachment record: 6f41a310-12f1-4336-9e2e-dae55768217b {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Successfully updated port: f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "refresh_cache-97135af5-e020-482b-a54b-6cf30a5443d4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquired lock "refresh_cache-97135af5-e020-482b-a54b-6cf30a5443d4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-a58cb465-f3ec-4b59-ab02-8a222423879a req-269cb02a-f650-4067-b974-c7049929863c service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Received event network-changed-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-a58cb465-f3ec-4b59-ab02-8a222423879a req-269cb02a-f650-4067-b974-c7049929863c service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Refreshing instance network info cache due to event network-changed-f1ab6143-1173-4e25-8f85-0f6b4517b2f0. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:25:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a58cb465-f3ec-4b59-ab02-8a222423879a req-269cb02a-f650-4067-b974-c7049929863c service nova] Acquiring lock "refresh_cache-97135af5-e020-482b-a54b-6cf30a5443d4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Updating instance_info_cache with network_info: [{"id": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "address": "fa:16:3e:dd:4c:bc", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ab6143-11", "ovs_interfaceid": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Releasing lock "refresh_cache-97135af5-e020-482b-a54b-6cf30a5443d4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Instance network_info: |[{"id": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "address": "fa:16:3e:dd:4c:bc", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ab6143-11", "ovs_interfaceid": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a58cb465-f3ec-4b59-ab02-8a222423879a req-269cb02a-f650-4067-b974-c7049929863c service nova] Acquired lock "refresh_cache-97135af5-e020-482b-a54b-6cf30a5443d4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.network.neutron [req-a58cb465-f3ec-4b59-ab02-8a222423879a req-269cb02a-f650-4067-b974-c7049929863c service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Refreshing network info cache for port f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Start _get_guest_xml network_info=[{"id": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "address": "fa:16:3e:dd:4c:bc", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ab6143-11", "ovs_interfaceid": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:25:12 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:12 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1447727992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1447727992',id=24,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621284eebf704320bacac96aedbc77a4',ramdisk_id='',reservation_id='r-dmw3a84j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:25:11Z,user_data=None,user_id='6ed5db501b2e4dcfb742e18dfdeae88b',uuid=97135af5-e020-482b-a54b-6cf30a5443d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "address": "fa:16:3e:dd:4c:bc", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ab6143-11", "ovs_interfaceid": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converting VIF {"id": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "address": "fa:16:3e:dd:4c:bc", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ab6143-11", "ovs_interfaceid": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1ab6143-1173-4e25-8f85-0f6b4517b2f0,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ab6143-11') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.objects.instance [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'pci_devices' on Instance uuid 97135af5-e020-482b-a54b-6cf30a5443d4 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:25:12 user nova-compute[74658]:   <uuid>97135af5-e020-482b-a54b-6cf30a5443d4</uuid>
Nov 16 15:25:12 user nova-compute[74658]:   <name>instance-00000018</name>
Nov 16 15:25:12 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:25:12 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:25:12 user nova-compute[74658]:   <metadata>
Nov 16 15:25:12 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:25:12 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:25:12 user nova-compute[74658]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1447727992</nova:name>
Nov 16 15:25:12 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:25:12</nova:creationTime>
Nov 16 15:25:12 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:25:12 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:25:12 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:25:12 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:25:12 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:25:12 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:25:12 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:25:12 user nova-compute[74658]:       <nova:owner>
Nov 16 15:25:12 user nova-compute[74658]:         <nova:user uuid="6ed5db501b2e4dcfb742e18dfdeae88b">tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member</nova:user>
Nov 16 15:25:12 user nova-compute[74658]:         <nova:project uuid="621284eebf704320bacac96aedbc77a4">tempest-ServerBootFromVolumeStableRescueTest-1170309652</nova:project>
Nov 16 15:25:12 user nova-compute[74658]:       </nova:owner>
Nov 16 15:25:12 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:25:12 user nova-compute[74658]:       <nova:ports>
Nov 16 15:25:12 user nova-compute[74658]:         <nova:port uuid="f1ab6143-1173-4e25-8f85-0f6b4517b2f0">
Nov 16 15:25:12 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 15:25:12 user nova-compute[74658]:         </nova:port>
Nov 16 15:25:12 user nova-compute[74658]:       </nova:ports>
Nov 16 15:25:12 user nova-compute[74658]:     </nova:instance>
Nov 16 15:25:12 user nova-compute[74658]:   </metadata>
Nov 16 15:25:12 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:25:12 user nova-compute[74658]:     <system>
Nov 16 15:25:12 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:25:12 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:25:12 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:25:12 user nova-compute[74658]:       <entry name="serial">97135af5-e020-482b-a54b-6cf30a5443d4</entry>
Nov 16 15:25:12 user nova-compute[74658]:       <entry name="uuid">97135af5-e020-482b-a54b-6cf30a5443d4</entry>
Nov 16 15:25:12 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:25:12 user nova-compute[74658]:     </system>
Nov 16 15:25:12 user nova-compute[74658]:   </sysinfo>
Nov 16 15:25:12 user nova-compute[74658]:   <os>
Nov 16 15:25:12 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:25:12 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:25:12 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:25:12 user nova-compute[74658]:   </os>
Nov 16 15:25:12 user nova-compute[74658]:   <features>
Nov 16 15:25:12 user nova-compute[74658]:     <acpi/>
Nov 16 15:25:12 user nova-compute[74658]:     <apic/>
Nov 16 15:25:12 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:25:12 user nova-compute[74658]:   </features>
Nov 16 15:25:12 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:25:12 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:25:12 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:25:12 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:25:12 user nova-compute[74658]:   </clock>
Nov 16 15:25:12 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:25:12 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:25:12 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:25:12 user nova-compute[74658]:   </cpu>
Nov 16 15:25:12 user nova-compute[74658]:   <devices>
Nov 16 15:25:12 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:25:12 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:25:12 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk"/>
Nov 16 15:25:12 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:25:12 user nova-compute[74658]:     </disk>
Nov 16 15:25:12 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:25:12 user nova-compute[74658]:       <mac address="fa:16:3e:dd:4c:bc"/>
Nov 16 15:25:12 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:25:12 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:25:12 user nova-compute[74658]:       <target dev="tapf1ab6143-11"/>
Nov 16 15:25:12 user nova-compute[74658]:     </interface>
Nov 16 15:25:12 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:25:12 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/console.log" append="off"/>
Nov 16 15:25:12 user nova-compute[74658]:     </serial>
Nov 16 15:25:12 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:25:12 user nova-compute[74658]:     <video>
Nov 16 15:25:12 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:25:12 user nova-compute[74658]:     </video>
Nov 16 15:25:12 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:25:12 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:25:12 user nova-compute[74658]:     </rng>
Nov 16 15:25:12 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:25:12 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:25:12 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:25:12 user nova-compute[74658]:     </memballoon>
Nov 16 15:25:12 user nova-compute[74658]:   </devices>
Nov 16 15:25:12 user nova-compute[74658]: </domain>
Nov 16 15:25:12 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1447727992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1447727992',id=24,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621284eebf704320bacac96aedbc77a4',ramdisk_id='',reservation_id='r-dmw3a84j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:25:11Z,user_data=None,user_id='6ed5db501b2e4dcfb742e18dfdeae88b',uuid=97135af5-e020-482b-a54b-6cf30a5443d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "address": "fa:16:3e:dd:4c:bc", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ab6143-11", "ovs_interfaceid": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converting VIF {"id": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "address": "fa:16:3e:dd:4c:bc", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ab6143-11", "ovs_interfaceid": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1ab6143-1173-4e25-8f85-0f6b4517b2f0,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ab6143-11') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG os_vif [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1ab6143-1173-4e25-8f85-0f6b4517b2f0,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ab6143-11') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b0d3e31-e266-5b73-8073-4be495d46f07', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1ab6143-11, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1ab6143-11, col_values=(('qos', UUID('7aad2cb5-3447-40d3-b788-984a09d526aa')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1ab6143-11, col_values=(('external_ids', {'iface-id': 'f1ab6143-1173-4e25-8f85-0f6b4517b2f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:4c:bc', 'vm-uuid': '97135af5-e020-482b-a54b-6cf30a5443d4'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:12 user nova-compute[74658]: INFO os_vif [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1ab6143-1173-4e25-8f85-0f6b4517b2f0,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ab6143-11')
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] No VIF found with MAC fa:16:3e:dd:4c:bc, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-d4a19755-a689-4ba2-af41-f31cd7557fc5 req-7c323a55-69f5-48a5-aee5-e32553500052 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d4a19755-a689-4ba2-af41-f31cd7557fc5 req-7c323a55-69f5-48a5-aee5-e32553500052 service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d4a19755-a689-4ba2-af41-f31cd7557fc5 req-7c323a55-69f5-48a5-aee5-e32553500052 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d4a19755-a689-4ba2-af41-f31cd7557fc5 req-7c323a55-69f5-48a5-aee5-e32553500052 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-d4a19755-a689-4ba2-af41-f31cd7557fc5 req-7c323a55-69f5-48a5-aee5-e32553500052 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:13 user nova-compute[74658]: WARNING nova.compute.manager [req-d4a19755-a689-4ba2-af41-f31cd7557fc5 req-7c323a55-69f5-48a5-aee5-e32553500052 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received unexpected event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with vm_state active and task_state None.
Nov 16 15:25:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-a58cb465-f3ec-4b59-ab02-8a222423879a req-269cb02a-f650-4067-b974-c7049929863c service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Updated VIF entry in instance network info cache for port f1ab6143-1173-4e25-8f85-0f6b4517b2f0. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-a58cb465-f3ec-4b59-ab02-8a222423879a req-269cb02a-f650-4067-b974-c7049929863c service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Updating instance_info_cache with network_info: [{"id": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "address": "fa:16:3e:dd:4c:bc", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ab6143-11", "ovs_interfaceid": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a58cb465-f3ec-4b59-ab02-8a222423879a req-269cb02a-f650-4067-b974-c7049929863c service nova] Releasing lock "refresh_cache-97135af5-e020-482b-a54b-6cf30a5443d4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] No waiting events found dispatching network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:14 user nova-compute[74658]: WARNING nova.compute.manager [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received unexpected event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 for instance with vm_state building and task_state spawning.
Nov 16 15:25:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] No waiting events found dispatching network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:14 user nova-compute[74658]: WARNING nova.compute.manager [req-af0dbcb8-5ede-4b50-9637-6b86442abab6 req-c475bcac-faa0-4cb1-82e7-8f3b4808446e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received unexpected event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 for instance with vm_state building and task_state spawning.
Nov 16 15:25:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:15 user nova-compute[74658]: WARNING nova.compute.manager [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received unexpected event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with vm_state active and task_state None.
Nov 16 15:25:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Received event network-vif-plugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] Acquiring lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] Lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] Lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] No waiting events found dispatching network-vif-plugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:15 user nova-compute[74658]: WARNING nova.compute.manager [req-0b0bb3ce-8167-4324-b894-fa77d326838c req-4b540fff-4b0f-4398-97cd-c4b61be725e3 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Received unexpected event network-vif-plugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 for instance with vm_state building and task_state spawning.
Nov 16 15:25:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:25:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:25:16 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Instance spawned successfully.
Nov 16 15:25:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:25:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:16 user nova-compute[74658]: INFO nova.compute.manager [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Took 7.76 seconds to spawn the instance on the hypervisor.
Nov 16 15:25:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:25:16 user nova-compute[74658]: INFO nova.compute.manager [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Took 8.62 seconds to build instance.
Nov 16 15:25:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d00f8cd6-bbd8-42d0-a357-2c6c092c2433 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.723s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:25:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Instance spawned successfully.
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:17 user nova-compute[74658]: INFO nova.compute.manager [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-e086176d-e99f-4340-b061-43d6c9355064 req-f4ce2c1e-15c1-43fe-b6af-3cc71251c0c8 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Received event network-vif-plugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e086176d-e99f-4340-b061-43d6c9355064 req-f4ce2c1e-15c1-43fe-b6af-3cc71251c0c8 service nova] Acquiring lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e086176d-e99f-4340-b061-43d6c9355064 req-f4ce2c1e-15c1-43fe-b6af-3cc71251c0c8 service nova] Lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e086176d-e99f-4340-b061-43d6c9355064 req-f4ce2c1e-15c1-43fe-b6af-3cc71251c0c8 service nova] Lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-e086176d-e99f-4340-b061-43d6c9355064 req-f4ce2c1e-15c1-43fe-b6af-3cc71251c0c8 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] No waiting events found dispatching network-vif-plugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:17 user nova-compute[74658]: WARNING nova.compute.manager [req-e086176d-e99f-4340-b061-43d6c9355064 req-f4ce2c1e-15c1-43fe-b6af-3cc71251c0c8 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Received unexpected event network-vif-plugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 for instance with vm_state building and task_state spawning.
Nov 16 15:25:17 user nova-compute[74658]: INFO nova.compute.manager [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Took 7.92 seconds to build instance.
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-908d8575-9551-41cb-9e1e-c4bb1cd5af9b tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "97135af5-e020-482b-a54b-6cf30a5443d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.512s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:25:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Creating image(s)
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Ensure instance console log exists: /opt/stack/data/nova/instances/e7150393-ff50-4c0a-a904-4e4486925bb9/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Start _get_guest_xml network_info=[{"id": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "address": "fa:16:3e:18:c9:56", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b91b137-0a", "ovs_interfaceid": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6f41a310-12f1-4336-9e2e-dae55768217b', 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YndLFXlK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e7150393-ff50-4c0a-a904-4e4486925bb9', 'attached_at': '', 'detached_at': '', 'volume_id': '7f1e77cb-5aab-49ce-93f7-46ea8a5a9926', 'serial': '7f1e77cb-5aab-49ce-93f7-46ea8a5a9926'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:25:17 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:17 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YndLFXlK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:25:17 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:25:17 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:25:17 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba542823-b6cc-4ffe-b194-60ff697147fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:25:17 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a748233-f285-4e2d-bf43-595f8ad82ce3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926] added
Nov 16 15:25:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c46e16-2791-4056-a699-e709622c34df]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[682643c2-b2c5-43d3-acdf-38cd90394355]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YndLFXlK {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YndLFXlK" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b32129-0eae-413e-922f-4b20fbdd6c01]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YndLFXlK'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7136a8b3-cd87-473e-a218-e0e6e734e6de]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8581b883-1881-43fa-899f-4f18705df7b5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:25:17 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:25:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:25:17 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:25:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[418cc707-fc3a-4445-8190-62bbe7e88235]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926, portal: 172.16.0.220,3260]
Nov 16 15:25:17 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926, portal: 172.16.0.220,3260] successful.
Nov 16 15:25:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3be8a4-a5a9-45f0-bd6d-30b73992b732]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[991b8f96-8180-4ab8-95ce-a0a2d18cef58]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:25:17 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:25:17 user nova-compute[74658]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)
Nov 16 15:25:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:25:17 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:25:17 user nova-compute[74658]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)
Nov 16 15:25:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:25:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ccbdce-c63e-40e7-8e48-0a425e190bb2]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YndLFXlK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:18 user nova-compute[74658]: INFO nova.compute.manager [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Terminating instance
Nov 16 15:25:18 user nova-compute[74658]: DEBUG nova.compute.manager [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "1ce290f3-7d0c-4475-8087-5c1e032893b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-c60f8a28-ba7c-4ab7-bece-1cdb9ed23b15 req-5b4bf26b-60dd-4dfc-bf79-c73961fa113b service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-unplugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c60f8a28-ba7c-4ab7-bece-1cdb9ed23b15 req-5b4bf26b-60dd-4dfc-bf79-c73961fa113b service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c60f8a28-ba7c-4ab7-bece-1cdb9ed23b15 req-5b4bf26b-60dd-4dfc-bf79-c73961fa113b service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c60f8a28-ba7c-4ab7-bece-1cdb9ed23b15 req-5b4bf26b-60dd-4dfc-bf79-c73961fa113b service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-c60f8a28-ba7c-4ab7-bece-1cdb9ed23b15 req-5b4bf26b-60dd-4dfc-bf79-c73961fa113b service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-unplugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-c60f8a28-ba7c-4ab7-bece-1cdb9ed23b15 req-5b4bf26b-60dd-4dfc-bf79-c73961fa113b service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-unplugged-7835b05b-5b80-4071-9f12-34a63399f7b8 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:18 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:25:18 user nova-compute[74658]: INFO nova.compute.claims [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Claim successful on node user
Nov 16 15:25:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26266386630633736', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266386630633736', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1809069359',display_name='tempest-TestVolumeBootPattern-server-1809069359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1809069359',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-bjrgpaao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:25:06Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=e7150393-ff50-4c0a-a904-4e4486925bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "address": "fa:16:3e:18:c9:56", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b91b137-0a", "ovs_interfaceid": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "address": "fa:16:3e:18:c9:56", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b91b137-0a", "ovs_interfaceid": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:c9:56,bridge_name='br-int',has_traffic_filtering=True,id=9b91b137-0a00-4ec5-960c-908ca38f9dc9,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b91b137-0a') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.objects.instance [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'pci_devices' on Instance uuid e7150393-ff50-4c0a-a904-4e4486925bb9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:25:19 user nova-compute[74658]:   <uuid>e7150393-ff50-4c0a-a904-4e4486925bb9</uuid>
Nov 16 15:25:19 user nova-compute[74658]:   <name>instance-00000016</name>
Nov 16 15:25:19 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:25:19 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:25:19 user nova-compute[74658]:   <metadata>
Nov 16 15:25:19 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:25:19 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:25:19 user nova-compute[74658]:       <nova:name>tempest-TestVolumeBootPattern-server-1809069359</nova:name>
Nov 16 15:25:19 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:25:17</nova:creationTime>
Nov 16 15:25:19 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:25:19 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:25:19 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:25:19 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:25:19 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:25:19 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:25:19 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:25:19 user nova-compute[74658]:       <nova:owner>
Nov 16 15:25:19 user nova-compute[74658]:         <nova:user uuid="aed7ea9505b3400ebbe1ce456419bc82">tempest-TestVolumeBootPattern-1853010836-project-member</nova:user>
Nov 16 15:25:19 user nova-compute[74658]:         <nova:project uuid="2156886e7c2247e38a1ffe4025798a96">tempest-TestVolumeBootPattern-1853010836</nova:project>
Nov 16 15:25:19 user nova-compute[74658]:       </nova:owner>
Nov 16 15:25:19 user nova-compute[74658]:       <nova:ports>
Nov 16 15:25:19 user nova-compute[74658]:         <nova:port uuid="9b91b137-0a00-4ec5-960c-908ca38f9dc9">
Nov 16 15:25:19 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 15:25:19 user nova-compute[74658]:         </nova:port>
Nov 16 15:25:19 user nova-compute[74658]:       </nova:ports>
Nov 16 15:25:19 user nova-compute[74658]:     </nova:instance>
Nov 16 15:25:19 user nova-compute[74658]:   </metadata>
Nov 16 15:25:19 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:25:19 user nova-compute[74658]:     <system>
Nov 16 15:25:19 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:25:19 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:25:19 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:25:19 user nova-compute[74658]:       <entry name="serial">e7150393-ff50-4c0a-a904-4e4486925bb9</entry>
Nov 16 15:25:19 user nova-compute[74658]:       <entry name="uuid">e7150393-ff50-4c0a-a904-4e4486925bb9</entry>
Nov 16 15:25:19 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:25:19 user nova-compute[74658]:     </system>
Nov 16 15:25:19 user nova-compute[74658]:   </sysinfo>
Nov 16 15:25:19 user nova-compute[74658]:   <os>
Nov 16 15:25:19 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:25:19 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:25:19 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:25:19 user nova-compute[74658]:   </os>
Nov 16 15:25:19 user nova-compute[74658]:   <features>
Nov 16 15:25:19 user nova-compute[74658]:     <acpi/>
Nov 16 15:25:19 user nova-compute[74658]:     <apic/>
Nov 16 15:25:19 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:25:19 user nova-compute[74658]:   </features>
Nov 16 15:25:19 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:25:19 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:25:19 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:25:19 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:25:19 user nova-compute[74658]:   </clock>
Nov 16 15:25:19 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:25:19 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:25:19 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:25:19 user nova-compute[74658]:   </cpu>
Nov 16 15:25:19 user nova-compute[74658]:   <devices>
Nov 16 15:25:19 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:25:19 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:25:19 user nova-compute[74658]:       <source dev="/dev/sdb"/>
Nov 16 15:25:19 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:25:19 user nova-compute[74658]:       <serial>7f1e77cb-5aab-49ce-93f7-46ea8a5a9926</serial>
Nov 16 15:25:19 user nova-compute[74658]:     </disk>
Nov 16 15:25:19 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:25:19 user nova-compute[74658]:       <mac address="fa:16:3e:18:c9:56"/>
Nov 16 15:25:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:25:19 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:25:19 user nova-compute[74658]:       <target dev="tap9b91b137-0a"/>
Nov 16 15:25:19 user nova-compute[74658]:     </interface>
Nov 16 15:25:19 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:25:19 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/e7150393-ff50-4c0a-a904-4e4486925bb9/console.log" append="off"/>
Nov 16 15:25:19 user nova-compute[74658]:     </serial>
Nov 16 15:25:19 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:25:19 user nova-compute[74658]:     <video>
Nov 16 15:25:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:25:19 user nova-compute[74658]:     </video>
Nov 16 15:25:19 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:25:19 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:25:19 user nova-compute[74658]:     </rng>
Nov 16 15:25:19 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:25:19 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:25:19 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:25:19 user nova-compute[74658]:     </memballoon>
Nov 16 15:25:19 user nova-compute[74658]:   </devices>
Nov 16 15:25:19 user nova-compute[74658]: </domain>
Nov 16 15:25:19 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1809069359',display_name='tempest-TestVolumeBootPattern-server-1809069359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1809069359',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-bjrgpaao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:25:06Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=e7150393-ff50-4c0a-a904-4e4486925bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "address": "fa:16:3e:18:c9:56", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b91b137-0a", "ovs_interfaceid": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "address": "fa:16:3e:18:c9:56", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b91b137-0a", "ovs_interfaceid": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:c9:56,bridge_name='br-int',has_traffic_filtering=True,id=9b91b137-0a00-4ec5-960c-908ca38f9dc9,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b91b137-0a') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG os_vif [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c9:56,bridge_name='br-int',has_traffic_filtering=True,id=9b91b137-0a00-4ec5-960c-908ca38f9dc9,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b91b137-0a') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ea9279d-f285-5bfb-a3f4-60f8618f7ac0', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b91b137-0a, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b91b137-0a, col_values=(('qos', UUID('9cf9c54b-1e5a-4f43-bbb8-fbe2990f9b7a')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b91b137-0a, col_values=(('external_ids', {'iface-id': '9b91b137-0a00-4ec5-960c-908ca38f9dc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:c9:56', 'vm-uuid': 'e7150393-ff50-4c0a-a904-4e4486925bb9'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: INFO os_vif [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c9:56,bridge_name='br-int',has_traffic_filtering=True,id=9b91b137-0a00-4ec5-960c-908ca38f9dc9,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b91b137-0a')
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No VIF found with MAC fa:16:3e:18:c9:56, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:25:19 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Instance destroyed successfully.
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.objects.instance [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lazy-loading 'resources' on Instance uuid 6aa0fa12-4970-442d-ae49-36266e774d68 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T15:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-195038505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-195038505',id=18,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUYALn+Qe4bwBouHMM172AwnuDCo8Hub97tHOoN+sL0yYCQQKPRlPEZKYjt7+tYhGGAM1S+tJ0NSYwnH68UBRN5GsdSVFRHkmY5xPtQI9glZ3saVVE/aVmRO8U+qZ4/ZA==',key_name='tempest-keypair-498949403',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='246582f6f0c74a049de9e4d91f284c9b',ramdisk_id='',reservation_id='r-jlw5bbtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-281283563',owner_user_name='tempest-TaggedAttachmentsTest-281283563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa52214955ba4f01a25e5f74699f82b4',uuid=6aa0fa12-4970-442d-ae49-36266e774d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converting VIF {"id": "7835b05b-5b80-4071-9f12-34a63399f7b8", "address": "fa:16:3e:85:76:63", "network": {"id": "9773b97c-d7cf-4ef1-a989-d2e2fde157e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1699494692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246582f6f0c74a049de9e4d91f284c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7835b05b-5b", "ovs_interfaceid": "7835b05b-5b80-4071-9f12-34a63399f7b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:76:63,bridge_name='br-int',has_traffic_filtering=True,id=7835b05b-5b80-4071-9f12-34a63399f7b8,network=Network(9773b97c-d7cf-4ef1-a989-d2e2fde157e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7835b05b-5b') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG os_vif [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:76:63,bridge_name='br-int',has_traffic_filtering=True,id=7835b05b-5b80-4071-9f12-34a63399f7b8,network=Network(9773b97c-d7cf-4ef1-a989-d2e2fde157e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7835b05b-5b') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7835b05b-5b, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06c2dcc7-7d3d-49a5-be91-0e32dd557d33) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:25:19 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:25:19 user nova-compute[74658]: INFO os_vif [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:76:63,bridge_name='br-int',has_traffic_filtering=True,id=7835b05b-5b80-4071-9f12-34a63399f7b8,network=Network(9773b97c-d7cf-4ef1-a989-d2e2fde157e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7835b05b-5b')
Nov 16 15:25:19 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Deleting instance files /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68_del
Nov 16 15:25:19 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Deletion of /opt/stack/data/nova/instances/6aa0fa12-4970-442d-ae49-36266e774d68_del complete
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.policy [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '273f88233c0341b8a43761f45b3d9c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b1b7e5c218402b9575db3d0cde0396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:25:19 user nova-compute[74658]: INFO nova.compute.manager [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Took 1.56 seconds to destroy the instance on the hypervisor.
Nov 16 15:25:19 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:25:19 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:25:20 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Creating image(s)
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "/opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "/opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.249s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.229s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk 1073741824" returned: 0 in 0.092s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.198s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Successfully created port: 50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:20 user nova-compute[74658]: WARNING nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received unexpected event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 for instance with vm_state active and task_state deleting.
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:20 user nova-compute[74658]: WARNING nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received unexpected event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 for instance with vm_state active and task_state deleting.
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:20 user nova-compute[74658]: WARNING nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received unexpected event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 for instance with vm_state active and task_state deleting.
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-unplugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-unplugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-unplugged-7835b05b-5b80-4071-9f12-34a63399f7b8 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Acquiring lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] Lock "6aa0fa12-4970-442d-ae49-36266e774d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] No waiting events found dispatching network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:20 user nova-compute[74658]: WARNING nova.compute.manager [req-466c4055-769c-4993-9939-c23c5d80c475 req-1150af48-31b1-4cc9-a519-0c79e4ebf6f1 service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received unexpected event network-vif-plugged-7835b05b-5b80-4071-9f12-34a63399f7b8 for instance with vm_state active and task_state deleting.
Nov 16 15:25:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Cannot resize image /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Ensure instance console log exists: /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-8570545c-c373-4b31-a7fa-94524af3c17e req-e5ce3b54-80e8-4668-9804-6f13c861854a service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Received event network-vif-plugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8570545c-c373-4b31-a7fa-94524af3c17e req-e5ce3b54-80e8-4668-9804-6f13c861854a service nova] Acquiring lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8570545c-c373-4b31-a7fa-94524af3c17e req-e5ce3b54-80e8-4668-9804-6f13c861854a service nova] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8570545c-c373-4b31-a7fa-94524af3c17e req-e5ce3b54-80e8-4668-9804-6f13c861854a service nova] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-8570545c-c373-4b31-a7fa-94524af3c17e req-e5ce3b54-80e8-4668-9804-6f13c861854a service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] No waiting events found dispatching network-vif-plugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:21 user nova-compute[74658]: WARNING nova.compute.manager [req-8570545c-c373-4b31-a7fa-94524af3c17e req-e5ce3b54-80e8-4668-9804-6f13c861854a service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Received unexpected event network-vif-plugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 for instance with vm_state building and task_state spawning.
Nov 16 15:25:21 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-3d929af1-8e96-4136-850f-93a489c99ec2 req-785ed7a2-6d55-4315-8b84-23071b801c8b service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Received event network-vif-deleted-7835b05b-5b80-4071-9f12-34a63399f7b8 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:21 user nova-compute[74658]: INFO nova.compute.manager [req-3d929af1-8e96-4136-850f-93a489c99ec2 req-785ed7a2-6d55-4315-8b84-23071b801c8b service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Neutron deleted interface 7835b05b-5b80-4071-9f12-34a63399f7b8; detaching it from the instance and deleting it from the info cache
Nov 16 15:25:21 user nova-compute[74658]: DEBUG nova.network.neutron [req-3d929af1-8e96-4136-850f-93a489c99ec2 req-785ed7a2-6d55-4315-8b84-23071b801c8b service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:21 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Took 1.76 seconds to deallocate network for instance.
Nov 16 15:25:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-3d929af1-8e96-4136-850f-93a489c99ec2 req-785ed7a2-6d55-4315-8b84-23071b801c8b service nova] [instance: 6aa0fa12-4970-442d-ae49-36266e774d68] Detach interface failed, port_id=7835b05b-5b80-4071-9f12-34a63399f7b8, reason: Instance 6aa0fa12-4970-442d-ae49-36266e774d68 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Successfully updated port: 50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "refresh_cache-1ce290f3-7d0c-4475-8087-5c1e032893b6" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquired lock "refresh_cache-1ce290f3-7d0c-4475-8087-5c1e032893b6" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:22 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Deleted allocations for instance 6aa0fa12-4970-442d-ae49-36266e774d68
Nov 16 15:25:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70fb2bc3-7a5e-40fc-ac88-1d8622e13be1 tempest-TaggedAttachmentsTest-281283563 tempest-TaggedAttachmentsTest-281283563-project-member] Lock "6aa0fa12-4970-442d-ae49-36266e774d68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.046s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Updating instance_info_cache with network_info: [{"id": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "address": "fa:16:3e:b8:ac:8a", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dd6861-34", "ovs_interfaceid": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Releasing lock "refresh_cache-1ce290f3-7d0c-4475-8087-5c1e032893b6" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Instance network_info: |[{"id": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "address": "fa:16:3e:b8:ac:8a", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dd6861-34", "ovs_interfaceid": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Start _get_guest_xml network_info=[{"id": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "address": "fa:16:3e:b8:ac:8a", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dd6861-34", "ovs_interfaceid": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:25:22 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:22 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-69826594',display_name='tempest-VolumesAdminNegativeTest-server-69826594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-69826594',id=25,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80b1b7e5c218402b9575db3d0cde0396',ramdisk_id='',reservation_id='r-cg6imc10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2132519312',owner_user_name='tempest-VolumesAdminNegativeTest-2132519312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:25:20Z,user_data=None,user_id='273f88233c0341b8a43761f45b3d9c82',uuid=1ce290f3-7d0c-4475-8087-5c1e032893b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "address": "fa:16:3e:b8:ac:8a", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dd6861-34", "ovs_interfaceid": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converting VIF {"id": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "address": "fa:16:3e:b8:ac:8a", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dd6861-34", "ovs_interfaceid": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ac:8a,bridge_name='br-int',has_traffic_filtering=True,id=50dd6861-3478-4da5-8700-f46bcf8cfdd4,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dd6861-34') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ce290f3-7d0c-4475-8087-5c1e032893b6 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:25:22 user nova-compute[74658]:   <uuid>1ce290f3-7d0c-4475-8087-5c1e032893b6</uuid>
Nov 16 15:25:22 user nova-compute[74658]:   <name>instance-00000019</name>
Nov 16 15:25:22 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:25:22 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:25:22 user nova-compute[74658]:   <metadata>
Nov 16 15:25:22 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:25:22 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:25:22 user nova-compute[74658]:       <nova:name>tempest-VolumesAdminNegativeTest-server-69826594</nova:name>
Nov 16 15:25:22 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:25:22</nova:creationTime>
Nov 16 15:25:22 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:25:22 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:25:22 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:25:22 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:25:22 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:25:22 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:25:22 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:25:22 user nova-compute[74658]:       <nova:owner>
Nov 16 15:25:22 user nova-compute[74658]:         <nova:user uuid="273f88233c0341b8a43761f45b3d9c82">tempest-VolumesAdminNegativeTest-2132519312-project-member</nova:user>
Nov 16 15:25:22 user nova-compute[74658]:         <nova:project uuid="80b1b7e5c218402b9575db3d0cde0396">tempest-VolumesAdminNegativeTest-2132519312</nova:project>
Nov 16 15:25:22 user nova-compute[74658]:       </nova:owner>
Nov 16 15:25:22 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:25:22 user nova-compute[74658]:       <nova:ports>
Nov 16 15:25:22 user nova-compute[74658]:         <nova:port uuid="50dd6861-3478-4da5-8700-f46bcf8cfdd4">
Nov 16 15:25:22 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 15:25:22 user nova-compute[74658]:         </nova:port>
Nov 16 15:25:22 user nova-compute[74658]:       </nova:ports>
Nov 16 15:25:22 user nova-compute[74658]:     </nova:instance>
Nov 16 15:25:22 user nova-compute[74658]:   </metadata>
Nov 16 15:25:22 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:25:22 user nova-compute[74658]:     <system>
Nov 16 15:25:22 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:25:22 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:25:22 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:25:22 user nova-compute[74658]:       <entry name="serial">1ce290f3-7d0c-4475-8087-5c1e032893b6</entry>
Nov 16 15:25:22 user nova-compute[74658]:       <entry name="uuid">1ce290f3-7d0c-4475-8087-5c1e032893b6</entry>
Nov 16 15:25:22 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:25:22 user nova-compute[74658]:     </system>
Nov 16 15:25:22 user nova-compute[74658]:   </sysinfo>
Nov 16 15:25:22 user nova-compute[74658]:   <os>
Nov 16 15:25:22 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:25:22 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:25:22 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:25:22 user nova-compute[74658]:   </os>
Nov 16 15:25:22 user nova-compute[74658]:   <features>
Nov 16 15:25:22 user nova-compute[74658]:     <acpi/>
Nov 16 15:25:22 user nova-compute[74658]:     <apic/>
Nov 16 15:25:22 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:25:22 user nova-compute[74658]:   </features>
Nov 16 15:25:22 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:25:22 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:25:22 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:25:22 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:25:22 user nova-compute[74658]:   </clock>
Nov 16 15:25:22 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:25:22 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:25:22 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:25:22 user nova-compute[74658]:   </cpu>
Nov 16 15:25:22 user nova-compute[74658]:   <devices>
Nov 16 15:25:22 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:25:22 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:25:22 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk"/>
Nov 16 15:25:22 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:25:22 user nova-compute[74658]:     </disk>
Nov 16 15:25:22 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:25:22 user nova-compute[74658]:       <mac address="fa:16:3e:b8:ac:8a"/>
Nov 16 15:25:22 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:25:22 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:25:22 user nova-compute[74658]:       <target dev="tap50dd6861-34"/>
Nov 16 15:25:22 user nova-compute[74658]:     </interface>
Nov 16 15:25:22 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:25:22 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/console.log" append="off"/>
Nov 16 15:25:22 user nova-compute[74658]:     </serial>
Nov 16 15:25:22 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:25:22 user nova-compute[74658]:     <video>
Nov 16 15:25:22 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:25:22 user nova-compute[74658]:     </video>
Nov 16 15:25:22 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:25:22 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:25:22 user nova-compute[74658]:     </rng>
Nov 16 15:25:22 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:25:22 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:25:22 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:25:22 user nova-compute[74658]:     </memballoon>
Nov 16 15:25:22 user nova-compute[74658]:   </devices>
Nov 16 15:25:22 user nova-compute[74658]: </domain>
Nov 16 15:25:22 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-69826594',display_name='tempest-VolumesAdminNegativeTest-server-69826594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-69826594',id=25,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80b1b7e5c218402b9575db3d0cde0396',ramdisk_id='',reservation_id='r-cg6imc10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2132519312',owner_user_name='tempest-VolumesAdminNegativeTest-2132519312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:25:20Z,user_data=None,user_id='273f88233c0341b8a43761f45b3d9c82',uuid=1ce290f3-7d0c-4475-8087-5c1e032893b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "address": "fa:16:3e:b8:ac:8a", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dd6861-34", "ovs_interfaceid": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converting VIF {"id": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "address": "fa:16:3e:b8:ac:8a", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dd6861-34", "ovs_interfaceid": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ac:8a,bridge_name='br-int',has_traffic_filtering=True,id=50dd6861-3478-4da5-8700-f46bcf8cfdd4,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dd6861-34') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG os_vif [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ac:8a,bridge_name='br-int',has_traffic_filtering=True,id=50dd6861-3478-4da5-8700-f46bcf8cfdd4,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dd6861-34') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97076402-d23f-5080-85a9-ba66d1c98372', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50dd6861-34, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50dd6861-34, col_values=(('qos', UUID('97371fbb-2c99-49a5-8afd-c0499eb0364a')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50dd6861-34, col_values=(('external_ids', {'iface-id': '50dd6861-3478-4da5-8700-f46bcf8cfdd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:ac:8a', 'vm-uuid': '1ce290f3-7d0c-4475-8087-5c1e032893b6'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:22 user nova-compute[74658]: INFO os_vif [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ac:8a,bridge_name='br-int',has_traffic_filtering=True,id=50dd6861-3478-4da5-8700-f46bcf8cfdd4,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dd6861-34')
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:25:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] No VIF found with MAC fa:16:3e:b8:ac:8a, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:25:23 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Instance spawned successfully.
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:23 user nova-compute[74658]: INFO nova.compute.manager [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Received event network-vif-plugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] Acquiring lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] No waiting events found dispatching network-vif-plugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:23 user nova-compute[74658]: WARNING nova.compute.manager [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Received unexpected event network-vif-plugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 for instance with vm_state building and task_state spawning.
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Received event network-changed-50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Refreshing instance network info cache due to event network-changed-50dd6861-3478-4da5-8700-f46bcf8cfdd4. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] Acquiring lock "refresh_cache-1ce290f3-7d0c-4475-8087-5c1e032893b6" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] Acquired lock "refresh_cache-1ce290f3-7d0c-4475-8087-5c1e032893b6" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.network.neutron [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Refreshing network info cache for port 50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:25:23 user nova-compute[74658]: INFO nova.compute.manager [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Took 18.10 seconds to build instance.
Nov 16 15:25:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9f76ecdf-16c2-4eb8-83dc-85f5187bbdfe tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.203s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.network.neutron [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Updated VIF entry in instance network info cache for port 50dd6861-3478-4da5-8700-f46bcf8cfdd4. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG nova.network.neutron [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Updating instance_info_cache with network_info: [{"id": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "address": "fa:16:3e:b8:ac:8a", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dd6861-34", "ovs_interfaceid": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b033f98c-60f5-4a59-9f9d-e00fad3ec369 req-afd4eefe-cd36-4c8e-bc86-9b9a9f6c57c2 service nova] Releasing lock "refresh_cache-1ce290f3-7d0c-4475-8087-5c1e032893b6" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Received event network-vif-plugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] Acquiring lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] No waiting events found dispatching network-vif-plugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:25 user nova-compute[74658]: WARNING nova.compute.manager [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Received unexpected event network-vif-plugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 for instance with vm_state building and task_state spawning.
Nov 16 15:25:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Received event network-vif-plugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] Acquiring lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] No waiting events found dispatching network-vif-plugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:25 user nova-compute[74658]: WARNING nova.compute.manager [req-34fa1669-37bb-4a0d-85f2-94698194fa15 req-93babb73-4ed8-42b2-98eb-23b9a5ac0ca8 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Received unexpected event network-vif-plugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 for instance with vm_state building and task_state spawning.
Nov 16 15:25:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:25:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:25:26 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Instance spawned successfully.
Nov 16 15:25:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:25:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:25:26 user nova-compute[74658]: INFO nova.compute.manager [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Took 6.59 seconds to spawn the instance on the hypervisor.
Nov 16 15:25:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:25:26 user nova-compute[74658]: INFO nova.compute.manager [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Took 7.85 seconds to build instance.
Nov 16 15:25:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2321ebff-8669-4469-92c9-199a05f57388 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.964s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:41 user nova-compute[74658]: INFO nova.compute.manager [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Detaching volume e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:25:41 user nova-compute[74658]: INFO nova.virt.block_device [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Attempting to driver detach volume e52739fd-550d-422e-85ea-ac2c985424d0 from mountpoint /dev/vdb
Nov 16 15:25:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Attempting to detach device vdb from instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:25:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:25:42 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:25:42 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:25:42 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:25:42 user nova-compute[74658]:   <serial>e52739fd-550d-422e-85ea-ac2c985424d0</serial>
Nov 16 15:25:42 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 15:25:42 user nova-compute[74658]: </disk>
Nov 16 15:25:42 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:25:42 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully detached device vdb from instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d from the persistent domain config.
Nov 16 15:25:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:25:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:25:42 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:25:42 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:25:42 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:25:42 user nova-compute[74658]:   <serial>e52739fd-550d-422e-85ea-ac2c985424d0</serial>
Nov 16 15:25:42 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 15:25:42 user nova-compute[74658]: </disk>
Nov 16 15:25:42 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:25:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:25:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:47 user nova-compute[74658]: INFO nova.compute.manager [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Terminating instance
Nov 16 15:25:47 user nova-compute[74658]: DEBUG nova.compute.manager [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-23335cd4-3c7f-416a-92a9-71a6fb2500bf req-b910b3d1-38fe-4ef9-a3ea-33d91b21e312 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Received event network-vif-unplugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-23335cd4-3c7f-416a-92a9-71a6fb2500bf req-b910b3d1-38fe-4ef9-a3ea-33d91b21e312 service nova] Acquiring lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-23335cd4-3c7f-416a-92a9-71a6fb2500bf req-b910b3d1-38fe-4ef9-a3ea-33d91b21e312 service nova] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-23335cd4-3c7f-416a-92a9-71a6fb2500bf req-b910b3d1-38fe-4ef9-a3ea-33d91b21e312 service nova] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-23335cd4-3c7f-416a-92a9-71a6fb2500bf req-b910b3d1-38fe-4ef9-a3ea-33d91b21e312 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] No waiting events found dispatching network-vif-unplugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-23335cd4-3c7f-416a-92a9-71a6fb2500bf req-b910b3d1-38fe-4ef9-a3ea-33d91b21e312 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Received event network-vif-unplugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:25:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:48 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Instance destroyed successfully.
Nov 16 15:25:48 user nova-compute[74658]: DEBUG nova.objects.instance [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lazy-loading 'resources' on Instance uuid 03cbebbf-5414-4309-bfc1-ec0a67e09a7c {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-875708792',display_name='tempest-ServersNegativeTestJSON-server-875708792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-875708792',id=2,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af743d7342e44f64ae98c2d596eb63b1',ramdisk_id='',reservation_id='r-haczks62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-143070094',owner_user_name='tempest-ServersNegativeTestJSON-143070094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:17:23Z,user_data=None,user_id='d3ab7f89ab8d49c2a0f526c4c09a3b94',uuid=03cbebbf-5414-4309-bfc1-ec0a67e09a7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converting VIF {"id": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "address": "fa:16:3e:83:18:cf", "network": {"id": "d6f9a56c-c570-4cd8-8cf5-143503beec88", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-810916710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af743d7342e44f64ae98c2d596eb63b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b19cdcb-67", "ovs_interfaceid": "9b19cdcb-6717-4eab-bf59-01a9dae6ffe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:18:cf,bridge_name='br-int',has_traffic_filtering=True,id=9b19cdcb-6717-4eab-bf59-01a9dae6ffe4,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b19cdcb-67') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG os_vif [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:18:cf,bridge_name='br-int',has_traffic_filtering=True,id=9b19cdcb-6717-4eab-bf59-01a9dae6ffe4,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b19cdcb-67') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b19cdcb-67, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=261f525c-d473-4e3d-b1e7-01b7d783cf51) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:48 user nova-compute[74658]: INFO os_vif [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:18:cf,bridge_name='br-int',has_traffic_filtering=True,id=9b19cdcb-6717-4eab-bf59-01a9dae6ffe4,network=Network(d6f9a56c-c570-4cd8-8cf5-143503beec88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b19cdcb-67')
Nov 16 15:25:48 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Deleting instance files /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c_del
Nov 16 15:25:48 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Deletion of /opt/stack/data/nova/instances/03cbebbf-5414-4309-bfc1-ec0a67e09a7c_del complete
Nov 16 15:25:48 user nova-compute[74658]: INFO nova.compute.manager [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 15:25:48 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:48 user nova-compute[74658]: INFO nova.compute.manager [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Terminating instance
Nov 16 15:25:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:48 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Took 0.52 seconds to deallocate network for instance.
Nov 16 15:25:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-f8d84216-d29c-4af6-aedd-a892c8297bae req-eee4ce30-5936-4a5e-b61d-f6b6317b9714 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Received event network-vif-deleted-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:48 user nova-compute[74658]: INFO nova.compute.manager [req-f8d84216-d29c-4af6-aedd-a892c8297bae req-eee4ce30-5936-4a5e-b61d-f6b6317b9714 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Neutron deleted interface 9b19cdcb-6717-4eab-bf59-01a9dae6ffe4; detaching it from the instance and deleting it from the info cache
Nov 16 15:25:48 user nova-compute[74658]: DEBUG nova.network.neutron [req-f8d84216-d29c-4af6-aedd-a892c8297bae req-eee4ce30-5936-4a5e-b61d-f6b6317b9714 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-f8d84216-d29c-4af6-aedd-a892c8297bae req-eee4ce30-5936-4a5e-b61d-f6b6317b9714 service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Detach interface failed, port_id=9b19cdcb-6717-4eab-bf59-01a9dae6ffe4, reason: Instance 03cbebbf-5414-4309-bfc1-ec0a67e09a7c could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:49 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Deleted allocations for instance 03cbebbf-5414-4309-bfc1-ec0a67e09a7c
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de4bb27e-e119-4a0a-bf3c-b307b0f78c49 tempest-ServersNegativeTestJSON-143070094 tempest-ServersNegativeTestJSON-143070094-project-member] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:49 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Instance destroyed successfully.
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.objects.instance [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lazy-loading 'resources' on Instance uuid 51f00d67-ae3d-4d1b-a721-280bae2e9caf {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1901009930',display_name='tempest-ServerActionsTestOtherB-server-1901009930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1901009930',id=5,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfYsAQlC3nkxAyuTL+KN50dEAunY5gw1KQEIPq+iR4mJ4asJBSmjta4eGNIIDBn+5Mv+AkdxZhEfTWggAEXb2LpORaOL7hjybIPHi4K1ldg1rK7G6KYvZmZ7N35zLKD+g==',key_name='tempest-keypair-983162783',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1e465eeac8f4bc5b11c0a6e3a7bbc61',ramdisk_id='',reservation_id='r-gupt4lp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-662756880',owner_user_name='tempest-ServerActionsTestOtherB-662756880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aa837a8e0f14644a3b6b0d3904213f2',uuid=51f00d67-ae3d-4d1b-a721-280bae2e9caf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converting VIF {"id": "6abed81e-257d-4d47-a1b8-586c040fdc92", "address": "fa:16:3e:83:53:58", "network": {"id": "48b873a7-b2e0-4332-ae27-a6ac3c557683", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1435805198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1e465eeac8f4bc5b11c0a6e3a7bbc61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abed81e-25", "ovs_interfaceid": "6abed81e-257d-4d47-a1b8-586c040fdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_vif [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6abed81e-25, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5563b2f2-9f41-425f-bea7-157e9d425e79) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:25:49 user nova-compute[74658]: INFO os_vif [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:53:58,bridge_name='br-int',has_traffic_filtering=True,id=6abed81e-257d-4d47-a1b8-586c040fdc92,network=Network(48b873a7-b2e0-4332-ae27-a6ac3c557683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abed81e-25')
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZfabDrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:25:49 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5d318b-8d65-48d7-8e6c-bf121895e04b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:25:49 user nova-compute[74658]: No targets found.
Nov 16 15:25:49 user nova-compute[74658]: iSNS:
Nov 16 15:25:49 user nova-compute[74658]: No targets found.
Nov 16 15:25:49 user nova-compute[74658]: STATIC:
Nov 16 15:25:49 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926
Nov 16 15:25:49 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:25:49 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:25:49 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d
Nov 16 15:25:49 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:25:49 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:25:49 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:25:49 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:25:49 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:25:49 user nova-compute[74658]: FIRMWARE:
Nov 16 15:25:49 user nova-compute[74658]: No targets found.
Nov 16 15:25:49 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:25:49 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:25:49 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98232f3-9923-4017-b5ae-9ac6b280a3b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd1a041-e597-4073-94bf-1320fd5fe272]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:25:49 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:25:49 user nova-compute[74658]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)
Nov 16 15:25:49 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:25:49 user nova-compute[74658]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d (non-flash)
Nov 16 15:25:49 user nova-compute[74658]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)
Nov 16 15:25:49 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07300ad750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d'): ({'sdh'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Removing single pathed devices sdh {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[61359791-699f-4134-8d89-d76b80dda3c2]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b487571-3f1b-450f-a7ad-56f88d0565fd]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Flushing IO for device /dev/sdh {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[063cbc1a-26d2-40a6-9e69-30d0e318da0c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b38903-d36f-4c7c-bbec-53ec23c56747]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] SCSI volumes sdh have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5411231a-3c57-419e-9583-2d5fc6c69476]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Received event network-vif-plugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] Acquiring lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] Lock "03cbebbf-5414-4309-bfc1-ec0a67e09a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] No waiting events found dispatching network-vif-plugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:49 user nova-compute[74658]: WARNING nova.compute.manager [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] [instance: 03cbebbf-5414-4309-bfc1-ec0a67e09a7c] Received unexpected event network-vif-plugged-9b19cdcb-6717-4eab-bf59-01a9dae6ffe4 for instance with vm_state deleted and task_state None.
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-unplugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-unplugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-unplugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] Acquiring lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] No waiting events found dispatching network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:25:49 user nova-compute[74658]: WARNING nova.compute.manager [req-ed600388-5a8b-4df2-b8d4-bb3db650e78b req-b286eee9-19d7-4144-bbf9-65f213a0429f service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received unexpected event network-vif-plugged-6abed81e-257d-4d47-a1b8-586c040fdc92 for instance with vm_state active and task_state deleting.
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6495262d-d02d-453b-be89-681eea1786d2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260]
Nov 16 15:25:49 user nova-compute[74658]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d, portal: 172.16.0.220,3260] successful.
Nov 16 15:25:49 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4b2049-384a-4e93-a6ce-2b020659e81d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[24be5dab-93a5-461a-ac1d-35632cfbdb28]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] <== disconnect_volume: return (343ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:25:49 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Deleting instance files /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf_del
Nov 16 15:25:49 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Deletion of /opt/stack/data/nova/instances/51f00d67-ae3d-4d1b-a721-280bae2e9caf_del complete
Nov 16 15:25:49 user nova-compute[74658]: INFO nova.compute.manager [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 16 15:25:49 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:25:49 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:25:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:50 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:50 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Took 0.91 seconds to deallocate network for instance.
Nov 16 15:25:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-5710c3a0-3f31-429c-b13a-0b96cb3091ef req-e8820f63-5680-4e08-8d76-e1e37a8ce9cf service nova] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Received event network-vif-deleted-6abed81e-257d-4d47-a1b8-586c040fdc92 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:25:51 user nova-compute[74658]: INFO nova.compute.manager [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] [instance: 51f00d67-ae3d-4d1b-a721-280bae2e9caf] Took 0.72 seconds to detach 1 volumes for instance.
Nov 16 15:25:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:25:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:25:51 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:25:51 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:25:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:51 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Deleted allocations for instance 51f00d67-ae3d-4d1b-a721-280bae2e9caf
Nov 16 15:25:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-28260be4-cfd5-47b0-95e7-fd930c20e20b tempest-ServerActionsTestOtherB-662756880 tempest-ServerActionsTestOtherB-662756880-project-member] Lock "51f00d67-ae3d-4d1b-a721-280bae2e9caf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.582s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:25:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:57 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:25:59 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:25:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:25:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:25:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:25:59 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:25:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:25:59 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Updating instance_info_cache with network_info: [{"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:25:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:25:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d is timed out.
Nov 16 15:26:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully detached device vdb from instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d from the live domain config.
Nov 16 15:26:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALUJtqNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:26:02 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2a96ef-5070-4da1-99c8-da0ec0d4a439]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:26:02 user nova-compute[74658]: No targets found.
Nov 16 15:26:02 user nova-compute[74658]: iSNS:
Nov 16 15:26:02 user nova-compute[74658]: No targets found.
Nov 16 15:26:02 user nova-compute[74658]: STATIC:
Nov 16 15:26:02 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926
Nov 16 15:26:02 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:26:02 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:26:02 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0
Nov 16 15:26:02 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:26:02 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:26:02 user nova-compute[74658]: FIRMWARE:
Nov 16 15:26:02 user nova-compute[74658]: No targets found.
Nov 16 15:26:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:26:02 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:26:02 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e42d553-ea93-4fc4-ab3b-fbc4bac0cf8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b681bf-773b-422e-9c0e-e69d9fe6ce7a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:26:02 user nova-compute[74658]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)
Nov 16 15:26:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 (non-flash)
Nov 16 15:26:02 user nova-compute[74658]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)
Nov 16 15:26:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07101b9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ec9e60-afd1-49e1-81c5-ae246f071ca0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc31845-3065-4dd9-8e03-f223269674f4]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[716c28f7-aed1-4d6f-84f2-9aeac17e494a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea2cfc6-a055-4e8e-85cd-c9595b742320]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f528a6e6-5ecf-4362-bcf1-7c96606156ad]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a55fd5-c176-4178-a4de-f58296cd4382]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260]
Nov 16 15:26:02 user nova-compute[74658]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0, portal: 172.16.0.220,3260] successful.
Nov 16 15:26:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52739fd-550d-422e-85ea-ac2c985424d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac1820e-7309-4b75-9078-3a470579708f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== disconnect_volume: return (345ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'flavor' on Instance uuid e1a0ba07-9784-4984-a0a2-4dd1d55cb53d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:26:03 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:26:03 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:26:03 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7514MB free_disk=25.397682189941406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:26:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c45d9682-0f1d-4798-8587-b33bf8d16b40 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.127s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance bf2fe627-5a1c-44f0-b872-1d4275baac59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6c8dd806-c294-40dd-a13d-63659a1d5669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance e7150393-ff50-4c0a-a904-4e4486925bb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 97135af5-e020-482b-a54b-6cf30a5443d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 1ce290f3-7d0c-4475-8087-5c1e032893b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:26:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:26:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:26:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:26:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:26:06 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:26:07 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:26:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:26:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:26:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:32 user nova-compute[74658]: INFO nova.compute.manager [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Terminating instance
Nov 16 15:26:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG nova.compute.manager [req-81ae1ff8-7834-4333-8d7b-f30e2faad5f4 req-e1979bdd-d190-4c56-97a7-42d9265896e0 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-unplugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-81ae1ff8-7834-4333-8d7b-f30e2faad5f4 req-e1979bdd-d190-4c56-97a7-42d9265896e0 service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-81ae1ff8-7834-4333-8d7b-f30e2faad5f4 req-e1979bdd-d190-4c56-97a7-42d9265896e0 service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-81ae1ff8-7834-4333-8d7b-f30e2faad5f4 req-e1979bdd-d190-4c56-97a7-42d9265896e0 service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG nova.compute.manager [req-81ae1ff8-7834-4333-8d7b-f30e2faad5f4 req-e1979bdd-d190-4c56-97a7-42d9265896e0 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-unplugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG nova.compute.manager [req-81ae1ff8-7834-4333-8d7b-f30e2faad5f4 req-e1979bdd-d190-4c56-97a7-42d9265896e0 service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-unplugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:33 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Instance destroyed successfully.
Nov 16 15:26:33 user nova-compute[74658]: DEBUG nova.objects.instance [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'resources' on Instance uuid e1a0ba07-9784-4984-a0a2-4dd1d55cb53d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-973719147',display_name='tempest-ServerActionsTestOtherA-server-690127439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-973719147',id=14,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl++RKbB4aUMtrYmCOPdauQa/gpN9opiKUp/X+UapEvp1+7Y6F8dw6oyEwiFoEntT82tpQ3YHK6HAURo3UVwXD4GvU0Ji0v1dRcPaNdtl8esG6M51w55UWC2mDAZTpGjw==',key_name='tempest-keypair-851894490',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:23:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-kms34bsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=e1a0ba07-9784-4984-a0a2-4dd1d55cb53d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "address": "fa:16:3e:67:46:cc", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd5fe13-ad", "ovs_interfaceid": "7cd5fe13-ad8c-4d41-9e1e-09d269fd8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG os_vif [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cd5fe13-ad, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf1ec246-46a1-4bc7-9e6e-ea99c42d981a) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:33 user nova-compute[74658]: INFO os_vif [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cd5fe13-ad8c-4d41-9e1e-09d269fd8685,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd5fe13-ad')
Nov 16 15:26:33 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Deleting instance files /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d_del
Nov 16 15:26:33 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Deletion of /opt/stack/data/nova/instances/e1a0ba07-9784-4984-a0a2-4dd1d55cb53d_del complete
Nov 16 15:26:33 user nova-compute[74658]: INFO nova.compute.manager [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 15:26:33 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:26:33 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:26:34 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:26:34 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Took 1.18 seconds to deallocate network for instance.
Nov 16 15:26:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:34 user nova-compute[74658]: DEBUG nova.compute.manager [req-1db5274f-ed98-4ff6-ad64-922c6c70ff95 req-00dc7637-7ae4-45c0-9997-43b0afa2056d service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:26:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1db5274f-ed98-4ff6-ad64-922c6c70ff95 req-00dc7637-7ae4-45c0-9997-43b0afa2056d service nova] Acquiring lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1db5274f-ed98-4ff6-ad64-922c6c70ff95 req-00dc7637-7ae4-45c0-9997-43b0afa2056d service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1db5274f-ed98-4ff6-ad64-922c6c70ff95 req-00dc7637-7ae4-45c0-9997-43b0afa2056d service nova] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:34 user nova-compute[74658]: DEBUG nova.compute.manager [req-1db5274f-ed98-4ff6-ad64-922c6c70ff95 req-00dc7637-7ae4-45c0-9997-43b0afa2056d service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] No waiting events found dispatching network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:26:34 user nova-compute[74658]: WARNING nova.compute.manager [req-1db5274f-ed98-4ff6-ad64-922c6c70ff95 req-00dc7637-7ae4-45c0-9997-43b0afa2056d service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received unexpected event network-vif-plugged-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 for instance with vm_state deleted and task_state None.
Nov 16 15:26:34 user nova-compute[74658]: DEBUG nova.compute.manager [req-1db5274f-ed98-4ff6-ad64-922c6c70ff95 req-00dc7637-7ae4-45c0-9997-43b0afa2056d service nova] [instance: e1a0ba07-9784-4984-a0a2-4dd1d55cb53d] Received event network-vif-deleted-7cd5fe13-ad8c-4d41-9e1e-09d269fd8685 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:26:34 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:26:34 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:26:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:34 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Deleted allocations for instance e1a0ba07-9784-4984-a0a2-4dd1d55cb53d
Nov 16 15:26:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e33a4350-9fae-4119-b5b0-9024f2b92692 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "e1a0ba07-9784-4984-a0a2-4dd1d55cb53d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.668s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:26:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:26:52 user nova-compute[74658]: INFO nova.compute.claims [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Claim successful on node user
Nov 16 15:26:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-56fb9fed-4fb1-4b55-8ac4-31f47a429e9f req-781f7b7d-da99-46c1-a7ad-75e145c65ec8 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-changed-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:26:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-56fb9fed-4fb1-4b55-8ac4-31f47a429e9f req-781f7b7d-da99-46c1-a7ad-75e145c65ec8 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Refreshing instance network info cache due to event network-changed-add946f4-de44-48b9-9de4-3c76c1d1c8ae. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:26:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-56fb9fed-4fb1-4b55-8ac4-31f47a429e9f req-781f7b7d-da99-46c1-a7ad-75e145c65ec8 service nova] Acquiring lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:26:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-56fb9fed-4fb1-4b55-8ac4-31f47a429e9f req-781f7b7d-da99-46c1-a7ad-75e145c65ec8 service nova] Acquired lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:26:52 user nova-compute[74658]: DEBUG nova.network.neutron [req-56fb9fed-4fb1-4b55-8ac4-31f47a429e9f req-781f7b7d-da99-46c1-a7ad-75e145c65ec8 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Refreshing network info cache for port add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:26:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:26:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG nova.network.neutron [req-56fb9fed-4fb1-4b55-8ac4-31f47a429e9f req-781f7b7d-da99-46c1-a7ad-75e145c65ec8 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updated VIF entry in instance network info cache for port add946f4-de44-48b9-9de4-3c76c1d1c8ae. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG nova.network.neutron [req-56fb9fed-4fb1-4b55-8ac4-31f47a429e9f req-781f7b7d-da99-46c1-a7ad-75e145c65ec8 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updating instance_info_cache with network_info: [{"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-56fb9fed-4fb1-4b55-8ac4-31f47a429e9f req-781f7b7d-da99-46c1-a7ad-75e145c65ec8 service nova] Releasing lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:26:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Creating image(s)
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "/opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "/opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "/opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG nova.policy [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78e64660311e44e8aec0701ea52c2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e355315b27543ccacf00b9461cff1a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk 1073741824" returned: 0 in 0.053s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.195s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Successfully created port: 1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Cannot resize image /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Ensure instance console log exists: /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Successfully updated port: 1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquired lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-7f2039d3-3327-43b9-9b85-cea0b81ee5f7 req-501238e1-7323-4cc6-8700-e4c3e9b2ff32 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-changed-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-7f2039d3-3327-43b9-9b85-cea0b81ee5f7 req-501238e1-7323-4cc6-8700-e4c3e9b2ff32 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Refreshing instance network info cache due to event network-changed-1aaa65c9-53cf-439c-89b1-90afbc230119. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7f2039d3-3327-43b9-9b85-cea0b81ee5f7 req-501238e1-7323-4cc6-8700-e4c3e9b2ff32 service nova] Acquiring lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:26:54 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updating instance_info_cache with network_info: [{"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Releasing lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Instance network_info: |[{"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7f2039d3-3327-43b9-9b85-cea0b81ee5f7 req-501238e1-7323-4cc6-8700-e4c3e9b2ff32 service nova] Acquired lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-7f2039d3-3327-43b9-9b85-cea0b81ee5f7 req-501238e1-7323-4cc6-8700-e4c3e9b2ff32 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Refreshing network info cache for port 1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Start _get_guest_xml network_info=[{"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:26:55 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:26:55 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-909763891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-909763891',id=26,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6B2As6euHF6EOU2uQ2X/k5aA2RDKadyeTUrxMV8YTOQg0RBAAjU0lxyCB4onxqpvWrFnYJxo2/4tL7xWFO5wkc//rQaHy6VMnvx+fev8tC2XpCVog5oIo0Mep1avUsKA==',key_name='tempest-keypair-876002203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-m5jl5mv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=f314ad85-524a-4326-bdd5-2c7c4de78690,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.objects.instance [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'pci_devices' on Instance uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:26:55 user nova-compute[74658]:   <uuid>f314ad85-524a-4326-bdd5-2c7c4de78690</uuid>
Nov 16 15:26:55 user nova-compute[74658]:   <name>instance-0000001a</name>
Nov 16 15:26:55 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:26:55 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:26:55 user nova-compute[74658]:   <metadata>
Nov 16 15:26:55 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:26:55 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:26:55 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-909763891</nova:name>
Nov 16 15:26:55 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:26:55</nova:creationTime>
Nov 16 15:26:55 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:26:55 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:26:55 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:26:55 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:26:55 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:26:55 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:26:55 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:26:55 user nova-compute[74658]:       <nova:owner>
Nov 16 15:26:55 user nova-compute[74658]:         <nova:user uuid="78e64660311e44e8aec0701ea52c2bb6">tempest-AttachVolumeShelveTestJSON-1521088540-project-member</nova:user>
Nov 16 15:26:55 user nova-compute[74658]:         <nova:project uuid="8e355315b27543ccacf00b9461cff1a0">tempest-AttachVolumeShelveTestJSON-1521088540</nova:project>
Nov 16 15:26:55 user nova-compute[74658]:       </nova:owner>
Nov 16 15:26:55 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:26:55 user nova-compute[74658]:       <nova:ports>
Nov 16 15:26:55 user nova-compute[74658]:         <nova:port uuid="1aaa65c9-53cf-439c-89b1-90afbc230119">
Nov 16 15:26:55 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 15:26:55 user nova-compute[74658]:         </nova:port>
Nov 16 15:26:55 user nova-compute[74658]:       </nova:ports>
Nov 16 15:26:55 user nova-compute[74658]:     </nova:instance>
Nov 16 15:26:55 user nova-compute[74658]:   </metadata>
Nov 16 15:26:55 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:26:55 user nova-compute[74658]:     <system>
Nov 16 15:26:55 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:26:55 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:26:55 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:26:55 user nova-compute[74658]:       <entry name="serial">f314ad85-524a-4326-bdd5-2c7c4de78690</entry>
Nov 16 15:26:55 user nova-compute[74658]:       <entry name="uuid">f314ad85-524a-4326-bdd5-2c7c4de78690</entry>
Nov 16 15:26:55 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:26:55 user nova-compute[74658]:     </system>
Nov 16 15:26:55 user nova-compute[74658]:   </sysinfo>
Nov 16 15:26:55 user nova-compute[74658]:   <os>
Nov 16 15:26:55 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:26:55 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:26:55 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:26:55 user nova-compute[74658]:   </os>
Nov 16 15:26:55 user nova-compute[74658]:   <features>
Nov 16 15:26:55 user nova-compute[74658]:     <acpi/>
Nov 16 15:26:55 user nova-compute[74658]:     <apic/>
Nov 16 15:26:55 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:26:55 user nova-compute[74658]:   </features>
Nov 16 15:26:55 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:26:55 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:26:55 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:26:55 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:26:55 user nova-compute[74658]:   </clock>
Nov 16 15:26:55 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:26:55 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:26:55 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:26:55 user nova-compute[74658]:   </cpu>
Nov 16 15:26:55 user nova-compute[74658]:   <devices>
Nov 16 15:26:55 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:26:55 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:26:55 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk"/>
Nov 16 15:26:55 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:26:55 user nova-compute[74658]:     </disk>
Nov 16 15:26:55 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:26:55 user nova-compute[74658]:       <mac address="fa:16:3e:48:6b:ed"/>
Nov 16 15:26:55 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:26:55 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:26:55 user nova-compute[74658]:       <target dev="tap1aaa65c9-53"/>
Nov 16 15:26:55 user nova-compute[74658]:     </interface>
Nov 16 15:26:55 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:26:55 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/console.log" append="off"/>
Nov 16 15:26:55 user nova-compute[74658]:     </serial>
Nov 16 15:26:55 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:26:55 user nova-compute[74658]:     <video>
Nov 16 15:26:55 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:26:55 user nova-compute[74658]:     </video>
Nov 16 15:26:55 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:26:55 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:26:55 user nova-compute[74658]:     </rng>
Nov 16 15:26:55 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:26:55 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:26:55 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:26:55 user nova-compute[74658]:     </memballoon>
Nov 16 15:26:55 user nova-compute[74658]:   </devices>
Nov 16 15:26:55 user nova-compute[74658]: </domain>
Nov 16 15:26:55 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-909763891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-909763891',id=26,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6B2As6euHF6EOU2uQ2X/k5aA2RDKadyeTUrxMV8YTOQg0RBAAjU0lxyCB4onxqpvWrFnYJxo2/4tL7xWFO5wkc//rQaHy6VMnvx+fev8tC2XpCVog5oIo0Mep1avUsKA==',key_name='tempest-keypair-876002203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-m5jl5mv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=f314ad85-524a-4326-bdd5-2c7c4de78690,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG os_vif [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32824065-8eaf-5e0d-bec8-f8559b227ac4', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aaa65c9-53, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aaa65c9-53, col_values=(('qos', UUID('da9c801c-6477-47bd-96fb-065d7ce3a02a')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aaa65c9-53, col_values=(('external_ids', {'iface-id': '1aaa65c9-53cf-439c-89b1-90afbc230119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:6b:ed', 'vm-uuid': 'f314ad85-524a-4326-bdd5-2c7c4de78690'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:55 user nova-compute[74658]: INFO os_vif [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53')
Nov 16 15:26:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] No VIF found with MAC fa:16:3e:48:6b:ed, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-7f2039d3-3327-43b9-9b85-cea0b81ee5f7 req-501238e1-7323-4cc6-8700-e4c3e9b2ff32 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updated VIF entry in instance network info cache for port 1aaa65c9-53cf-439c-89b1-90afbc230119. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.network.neutron [req-7f2039d3-3327-43b9-9b85-cea0b81ee5f7 req-501238e1-7323-4cc6-8700-e4c3e9b2ff32 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updating instance_info_cache with network_info: [{"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7f2039d3-3327-43b9-9b85-cea0b81ee5f7 req-501238e1-7323-4cc6-8700-e4c3e9b2ff32 service nova] Releasing lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "e7150393-ff50-4c0a-a904-4e4486925bb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:55 user nova-compute[74658]: INFO nova.compute.manager [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Terminating instance
Nov 16 15:26:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:56 user nova-compute[74658]: INFO nova.compute.manager [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Attaching volume 7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 to /dev/vdb
Nov 16 15:26:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG os_brick.utils [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b91b010-bfa7-4aab-8270-27d0506b403d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d7fdcb-f1a0-4a33-b25d-d18bddd9b2ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[769736ef-5366-49fc-b060-285c7924abc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f78504-e2ae-4b02-9417-ca3ad9d80d5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-e2349d2a-3287-4d59-9c76-cf085617447d req-d0952f30-6a2e-4aa2-a706-09422d9493ee service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Received event network-vif-unplugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e2349d2a-3287-4d59-9c76-cf085617447d req-d0952f30-6a2e-4aa2-a706-09422d9493ee service nova] Acquiring lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e2349d2a-3287-4d59-9c76-cf085617447d req-d0952f30-6a2e-4aa2-a706-09422d9493ee service nova] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e2349d2a-3287-4d59-9c76-cf085617447d req-d0952f30-6a2e-4aa2-a706-09422d9493ee service nova] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-e2349d2a-3287-4d59-9c76-cf085617447d req-d0952f30-6a2e-4aa2-a706-09422d9493ee service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] No waiting events found dispatching network-vif-unplugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-e2349d2a-3287-4d59-9c76-cf085617447d req-d0952f30-6a2e-4aa2-a706-09422d9493ee service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Received event network-vif-unplugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:26:56 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fde751-ec0c-4c13-ada1-b7d854ccaac6]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG os_brick.utils [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updating existing volume attachment record: 861720e8-c725-4bd9-931c-a4327e33307f {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-244370bb-f60a-42a8-aa0f-78955442f932 req-8403d1d0-68cd-4dfe-8eb6-40ea88f6c0d9 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-244370bb-f60a-42a8-aa0f-78955442f932 req-8403d1d0-68cd-4dfe-8eb6-40ea88f6c0d9 service nova] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-244370bb-f60a-42a8-aa0f-78955442f932 req-8403d1d0-68cd-4dfe-8eb6-40ea88f6c0d9 service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-244370bb-f60a-42a8-aa0f-78955442f932 req-8403d1d0-68cd-4dfe-8eb6-40ea88f6c0d9 service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-244370bb-f60a-42a8-aa0f-78955442f932 req-8403d1d0-68cd-4dfe-8eb6-40ea88f6c0d9 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] No waiting events found dispatching network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:26:56 user nova-compute[74658]: WARNING nova.compute.manager [req-244370bb-f60a-42a8-aa0f-78955442f932 req-8403d1d0-68cd-4dfe-8eb6-40ea88f6c0d9 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received unexpected event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 for instance with vm_state building and task_state spawning.
Nov 16 15:26:57 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Instance destroyed successfully.
Nov 16 15:26:57 user nova-compute[74658]: DEBUG nova.objects.instance [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'resources' on Instance uuid e7150393-ff50-4c0a-a904-4e4486925bb9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1809069359',display_name='tempest-TestVolumeBootPattern-server-1809069359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1809069359',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-bjrgpaao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:25:23Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=e7150393-ff50-4c0a-a904-4e4486925bb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "address": "fa:16:3e:18:c9:56", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b91b137-0a", "ovs_interfaceid": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "address": "fa:16:3e:18:c9:56", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b91b137-0a", "ovs_interfaceid": "9b91b137-0a00-4ec5-960c-908ca38f9dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:c9:56,bridge_name='br-int',has_traffic_filtering=True,id=9b91b137-0a00-4ec5-960c-908ca38f9dc9,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b91b137-0a') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_vif [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c9:56,bridge_name='br-int',has_traffic_filtering=True,id=9b91b137-0a00-4ec5-960c-908ca38f9dc9,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b91b137-0a') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b91b137-0a, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cf9c54b-1e5a-4f43-bbb8-fbe2990f9b7a) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:57 user nova-compute[74658]: INFO os_vif [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c9:56,bridge_name='br-int',has_traffic_filtering=True,id=9b91b137-0a00-4ec5-960c-908ca38f9dc9,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b91b137-0a')
Nov 16 15:26:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YndLFXlK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:26:57 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6621ac5f-f591-495d-aad6-b2cea7de3d3e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:26:57 user nova-compute[74658]: No targets found.
Nov 16 15:26:57 user nova-compute[74658]: iSNS:
Nov 16 15:26:57 user nova-compute[74658]: No targets found.
Nov 16 15:26:57 user nova-compute[74658]: STATIC:
Nov 16 15:26:57 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926
Nov 16 15:26:57 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:26:57 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:26:57 user nova-compute[74658]: FIRMWARE:
Nov 16 15:26:57 user nova-compute[74658]: No targets found.
Nov 16 15:26:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:26:57 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:26:57 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[07047d6c-eb96-42f3-9327-5c52e9e47978]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7173f44-bf19-4e3a-a9f5-49671c744237]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)
Nov 16 15:26:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 (non-flash)
Nov 16 15:26:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0730462440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[417a2fec-c092-4734-a1b6-fd97ea13d025]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca465fe-4ab3-44f1-a73f-a3165ba01e22]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d08f328-0660-4092-8bcc-8927f98d9e7c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6b2b0b-111c-4280-a80a-61693176d160]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5438200f-c0a8-4471-9cfc-2a72726c9226]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bf2054-b6b8-4d1c-bfb3-9aa50973930d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926, portal: 172.16.0.220,3260]
Nov 16 15:26:57 user nova-compute[74658]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926, portal: 172.16.0.220,3260] successful.
Nov 16 15:26:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ae6392-9686-4db0-a6f9-fa64670eb7d9]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== disconnect_volume: return (351ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:26:57 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Deleting instance files /opt/stack/data/nova/instances/e7150393-ff50-4c0a-a904-4e4486925bb9_del
Nov 16 15:26:57 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Deletion of /opt/stack/data/nova/instances/e7150393-ff50-4c0a-a904-4e4486925bb9_del complete
Nov 16 15:26:57 user nova-compute[74658]: INFO nova.compute.manager [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Took 1.85 seconds to destroy the instance on the hypervisor.
Nov 16 15:26:57 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:26:57 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:26:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-ee39c2d0-961c-4215-8aa1-e7dcceb08cfb req-7be0144d-f634-4997-bf20-c18eda541c7f service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Received event network-vif-plugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:26:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ee39c2d0-961c-4215-8aa1-e7dcceb08cfb req-7be0144d-f634-4997-bf20-c18eda541c7f service nova] Acquiring lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ee39c2d0-961c-4215-8aa1-e7dcceb08cfb req-7be0144d-f634-4997-bf20-c18eda541c7f service nova] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ee39c2d0-961c-4215-8aa1-e7dcceb08cfb req-7be0144d-f634-4997-bf20-c18eda541c7f service nova] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-ee39c2d0-961c-4215-8aa1-e7dcceb08cfb req-7be0144d-f634-4997-bf20-c18eda541c7f service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] No waiting events found dispatching network-vif-plugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:26:58 user nova-compute[74658]: WARNING nova.compute.manager [req-ee39c2d0-961c-4215-8aa1-e7dcceb08cfb req-7be0144d-f634-4997-bf20-c18eda541c7f service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Received unexpected event network-vif-plugged-9b91b137-0a00-4ec5-960c-908ca38f9dc9 for instance with vm_state active and task_state deleting.
Nov 16 15:26:58 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:26:58 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Took 0.57 seconds to deallocate network for instance.
Nov 16 15:26:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-34f3f9f4-a972-49d2-b890-f218c687b827 req-8596662f-64f6-427a-8b3d-a9c28f577551 service nova] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Received event network-vif-deleted-9b91b137-0a00-4ec5-960c-908ca38f9dc9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:26:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-fde3872f-f78b-454a-a492-c672d350c38b req-87f687d1-a276-49f0-a04b-bd1a684b505a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:26:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fde3872f-f78b-454a-a492-c672d350c38b req-87f687d1-a276-49f0-a04b-bd1a684b505a service nova] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fde3872f-f78b-454a-a492-c672d350c38b req-87f687d1-a276-49f0-a04b-bd1a684b505a service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fde3872f-f78b-454a-a492-c672d350c38b req-87f687d1-a276-49f0-a04b-bd1a684b505a service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-fde3872f-f78b-454a-a492-c672d350c38b req-87f687d1-a276-49f0-a04b-bd1a684b505a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] No waiting events found dispatching network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:26:58 user nova-compute[74658]: WARNING nova.compute.manager [req-fde3872f-f78b-454a-a492-c672d350c38b req-87f687d1-a276-49f0-a04b-bd1a684b505a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received unexpected event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 for instance with vm_state building and task_state spawning.
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:26:59 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Instance spawned successfully.
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:26:59 user nova-compute[74658]: INFO nova.compute.manager [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:26:59 user nova-compute[74658]: INFO nova.compute.manager [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Took 0.79 seconds to detach 1 volumes for instance.
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: e7150393-ff50-4c0a-a904-4e4486925bb9] Deleting volume: 7f1e77cb-5aab-49ce-93f7-46ea8a5a9926 {{(pid=74658) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:26:59 user nova-compute[74658]: INFO nova.compute.manager [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Took 6.56 seconds to build instance.
Nov 16 15:26:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0d19938-c5ec-4428-b336-acd9ba69a1ac tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.682s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:26:59 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:27:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Updating instance_info_cache with network_info: [{"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:27:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-bf2fe627-5a1c-44f0-b872-1d4275baac59" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:27:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:27:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.753s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:00 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Deleted allocations for instance e7150393-ff50-4c0a-a904-4e4486925bb9
Nov 16 15:27:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c34274c0-4d61-4a3b-b6d2-06e0f041f85d tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "e7150393-ff50-4c0a-a904-4e4486925bb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.338s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:27:00 user nova-compute[74658]: INFO nova.compute.manager [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] instance snapshotting
Nov 16 15:27:00 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Beginning live snapshot process
Nov 16 15:27:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json -f qcow2 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json -f qcow2" returned: 0 in 0.257s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json -f qcow2 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptr69jm_j/54ea0e548dd94da8b58769470deaddcf.delta 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptr69jm_j/54ea0e548dd94da8b58769470deaddcf.delta 1073741824" returned: 0 in 0.053s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 15:27:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLMgEmIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:27:01 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:27:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:27:01 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:27:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:27:01 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b23f832-49a3-4fe6-b6b3-ae8e0d96f6f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:27:01 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1ea502-fb72-481d-8de6-01b46284eb4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7] added
Nov 16 15:27:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'flavor' on Instance uuid 38ff00d1-ed55-4b2e-8578-7d23241b14ae {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4109d1e-2938-4aa7-89b8-b639262daf1b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e91e684-9c29-4d2e-afd5-d5efbb890b61]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLMgEmIX {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLMgEmIX" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e5a68f-f12c-47f4-a8eb-ec8f292c55c6]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DLMgEmIX'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b69151-a28f-478d-8de8-d1ec4f417754]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2c191d-d46f-425a-b239-9d37287040d5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:27:02 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:27:02 user nova-compute[74658]:  {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:27:02 user nova-compute[74658]: WARNING os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 15:27:02 user nova-compute[74658]: 
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef66e890-ed33-4a9a-b719-e15c03747000]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260]
Nov 16 15:27:02 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260] successful.
Nov 16 15:27:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01da8c7-1bfe-420a-9b39-4b297dbe60f4]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:02 user nova-compute[74658]: INFO nova.compute.manager [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Attaching volume 117377d1-2f4a-48cd-8a28-4374d1d9e9de to /dev/vdb
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a1399d-f135-4bb5-81df-1963ce0c266c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:02 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e63eb63-e9e1-433b-b573-985f974bfa42]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLMgEmIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.utils [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5434b4a8-71a6-4205-9294-55c420958886]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bfa2f9-e0dd-4da8-90c8-40b68887a812]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d579d86a-34ab-4d38-b394-9608414358cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f62ab75-c7f2-46c1-8a88-4af7cbb88ece]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:27:02 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7398a50b-9455-42dd-a75f-501729d2d66d]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG os_brick.utils [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updating existing volume attachment record: baa42509-a51a-49b8-a71f-b2740bd85bc0 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] COPY block job progress, current cursor: 13828096 final cursor: 75497472 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23434353861643835', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434353861643835', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:27:03 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:27:03 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:27:03 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:27:03 user nova-compute[74658]:   <serial>7e403a0a-3fdc-495b-a0fb-5f05422f3ea7</serial>
Nov 16 15:27:03 user nova-compute[74658]: </disk>
Nov 16 15:27:03 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:27:03 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 15:27:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptr69jm_j/54ea0e548dd94da8b58769470deaddcf.delta /opt/stack/data/nova/instances/snapshots/tmptr69jm_j/54ea0e548dd94da8b58769470deaddcf {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:27:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No VIF found with MAC fa:16:3e:f1:80:2c, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptr69jm_j/54ea0e548dd94da8b58769470deaddcf.delta /opt/stack/data/nova/instances/snapshots/tmptr69jm_j/54ea0e548dd94da8b58769470deaddcf" returned: 0 in 0.680s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Snapshot extracted, beginning image upload
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0d89c7ee-b8a1-48f3-90a7-6a1d2b3c2c7f tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.531s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-309cb992-e7eb-4891-bc55-21929414220c tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-309cb992-e7eb-4891-bc55-21929414220c tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-309cb992-e7eb-4891-bc55-21929414220c tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-309cb992-e7eb-4891-bc55-21929414220c tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74658) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG nova.objects.instance [None req-309cb992-e7eb-4891-bc55-21929414220c tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-aeb425bd-82fa-4956-8b8c-1058e9c8798d req-f6d26444-7ffe-411b-a8f7-a8129a46380c service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-unplugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-aeb425bd-82fa-4956-8b8c-1058e9c8798d req-f6d26444-7ffe-411b-a8f7-a8129a46380c service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-aeb425bd-82fa-4956-8b8c-1058e9c8798d req-f6d26444-7ffe-411b-a8f7-a8129a46380c service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-aeb425bd-82fa-4956-8b8c-1058e9c8798d req-f6d26444-7ffe-411b-a8f7-a8129a46380c service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-aeb425bd-82fa-4956-8b8c-1058e9c8798d req-f6d26444-7ffe-411b-a8f7-a8129a46380c service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-unplugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:27:05 user nova-compute[74658]: WARNING nova.compute.manager [req-aeb425bd-82fa-4956-8b8c-1058e9c8798d req-f6d26444-7ffe-411b-a8f7-a8129a46380c service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received unexpected event network-vif-unplugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with vm_state active and task_state powering-off.
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:06 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance destroyed successfully.
Nov 16 15:27:06 user nova-compute[74658]: DEBUG nova.compute.manager [None req-309cb992-e7eb-4891-bc55-21929414220c tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:27:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-309cb992-e7eb-4891-bc55-21929414220c tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.958s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:07 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:27:07 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7990MB free_disk=25.401119232177734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance bf2fe627-5a1c-44f0-b872-1d4275baac59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6c8dd806-c294-40dd-a13d-63659a1d5669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 97135af5-e020-482b-a54b-6cf30a5443d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 1ce290f3-7d0c-4475-8087-5c1e032893b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance f314ad85-524a-4326-bdd5-2c7c4de78690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:07 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Snapshot image upload complete
Nov 16 15:27:07 user nova-compute[74658]: INFO nova.compute.manager [None req-0d887dd4-3d80-4f7b-ae4f-9def1c75dac7 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Took 7.18 seconds to snapshot the instance on the hypervisor.
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-1e59615c-985b-4965-a057-a2110a38b06c req-5fe05f5a-4c93-41f1-886b-a2856ba4051b service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1e59615c-985b-4965-a057-a2110a38b06c req-5fe05f5a-4c93-41f1-886b-a2856ba4051b service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1e59615c-985b-4965-a057-a2110a38b06c req-5fe05f5a-4c93-41f1-886b-a2856ba4051b service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1e59615c-985b-4965-a057-a2110a38b06c req-5fe05f5a-4c93-41f1-886b-a2856ba4051b service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-1e59615c-985b-4965-a057-a2110a38b06c req-5fe05f5a-4c93-41f1-886b-a2856ba4051b service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:27:07 user nova-compute[74658]: WARNING nova.compute.manager [req-1e59615c-985b-4965-a057-a2110a38b06c req-5fe05f5a-4c93-41f1-886b-a2856ba4051b service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received unexpected event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with vm_state stopped and task_state None.
Nov 16 15:27:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qunzHBNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:27:08 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:27:08 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:27:08 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3225956c-c8fb-48ac-8249-06ac3b13dcc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:27:08 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a69350f-8826-47c6-bd04-b18ea16897cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de] added
Nov 16 15:27:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e11e9e-cfc3-4056-bd42-4f1383166d71]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd571782-9ce0-4812-a11d-649a2618c859]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qunzHBNK {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qunzHBNK" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff87e9f-34c3-405f-ab3b-02daccf43355]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qunzHBNK'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e730e16d-1266-4e9d-b05a-4c32c54a66cf]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[057c3e85-800b-4731-a6c0-f48092ff53af]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1a3a6c-f4be-408b-9398-c476583ca3c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260]
Nov 16 15:27:08 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260] successful.
Nov 16 15:27:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc2af16-2874-48ae-8185-46f4b442f139]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a6eb15-f025-4f0a-b396-582244ad563d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:08 user nova-compute[74658]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:27:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:08 user nova-compute[74658]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:27:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c089c753-6456-4dd4-9ab4-303ca4877ce4]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qunzHBNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:27:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:27:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:27:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23039623836333264', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:27:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039623836333264', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:27:09 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'flavor' on Instance uuid 38ff00d1-ed55-4b2e-8578-7d23241b14ae {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:27:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:27:09 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:27:09 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:27:09 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:27:09 user nova-compute[74658]:   <serial>117377d1-2f4a-48cd-8a28-4374d1d9e9de</serial>
Nov 16 15:27:09 user nova-compute[74658]: </disk>
Nov 16 15:27:09 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:27:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:27:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:27:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] No VIF found with MAC fa:16:3e:48:94:b9, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:27:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0185e598-3021-4c2e-bf81-8c1866e6f3e2 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.092s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "1ce290f3-7d0c-4475-8087-5c1e032893b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:14 user nova-compute[74658]: INFO nova.compute.manager [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Terminating instance
Nov 16 15:27:14 user nova-compute[74658]: DEBUG nova.compute.manager [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:27:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-a67c2173-bdf8-4a35-a710-5eab3e05154f req-3aafeb97-8a78-4289-8557-230d78a01da3 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Received event network-vif-unplugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a67c2173-bdf8-4a35-a710-5eab3e05154f req-3aafeb97-8a78-4289-8557-230d78a01da3 service nova] Acquiring lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a67c2173-bdf8-4a35-a710-5eab3e05154f req-3aafeb97-8a78-4289-8557-230d78a01da3 service nova] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a67c2173-bdf8-4a35-a710-5eab3e05154f req-3aafeb97-8a78-4289-8557-230d78a01da3 service nova] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-a67c2173-bdf8-4a35-a710-5eab3e05154f req-3aafeb97-8a78-4289-8557-230d78a01da3 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] No waiting events found dispatching network-vif-unplugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-a67c2173-bdf8-4a35-a710-5eab3e05154f req-3aafeb97-8a78-4289-8557-230d78a01da3 service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Received event network-vif-unplugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:27:15 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Instance destroyed successfully.
Nov 16 15:27:15 user nova-compute[74658]: DEBUG nova.objects.instance [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lazy-loading 'resources' on Instance uuid 1ce290f3-7d0c-4475-8087-5c1e032893b6 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-69826594',display_name='tempest-VolumesAdminNegativeTest-server-69826594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-69826594',id=25,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80b1b7e5c218402b9575db3d0cde0396',ramdisk_id='',reservation_id='r-cg6imc10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2132519312',owner_user_name='tempest-VolumesAdminNegativeTest-2132519312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:25:27Z,user_data=None,user_id='273f88233c0341b8a43761f45b3d9c82',uuid=1ce290f3-7d0c-4475-8087-5c1e032893b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "address": "fa:16:3e:b8:ac:8a", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dd6861-34", "ovs_interfaceid": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converting VIF {"id": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "address": "fa:16:3e:b8:ac:8a", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dd6861-34", "ovs_interfaceid": "50dd6861-3478-4da5-8700-f46bcf8cfdd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ac:8a,bridge_name='br-int',has_traffic_filtering=True,id=50dd6861-3478-4da5-8700-f46bcf8cfdd4,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dd6861-34') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG os_vif [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ac:8a,bridge_name='br-int',has_traffic_filtering=True,id=50dd6861-3478-4da5-8700-f46bcf8cfdd4,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dd6861-34') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50dd6861-34, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97371fbb-2c99-49a5-8afd-c0499eb0364a) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:15 user nova-compute[74658]: INFO os_vif [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ac:8a,bridge_name='br-int',has_traffic_filtering=True,id=50dd6861-3478-4da5-8700-f46bcf8cfdd4,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dd6861-34')
Nov 16 15:27:15 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Deleting instance files /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6_del
Nov 16 15:27:15 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Deletion of /opt/stack/data/nova/instances/1ce290f3-7d0c-4475-8087-5c1e032893b6_del complete
Nov 16 15:27:15 user nova-compute[74658]: INFO nova.compute.manager [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 15:27:15 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:27:15 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-99668109-5943-4712-8282-4c7a4f0165b4 req-5a8a1b38-798f-4f77-98dd-4dde91633f1d service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Received event network-vif-deleted-50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:27:16 user nova-compute[74658]: INFO nova.compute.manager [req-99668109-5943-4712-8282-4c7a4f0165b4 req-5a8a1b38-798f-4f77-98dd-4dde91633f1d service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Neutron deleted interface 50dd6861-3478-4da5-8700-f46bcf8cfdd4; detaching it from the instance and deleting it from the info cache
Nov 16 15:27:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-99668109-5943-4712-8282-4c7a4f0165b4 req-5a8a1b38-798f-4f77-98dd-4dde91633f1d service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:27:16 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Took 0.47 seconds to deallocate network for instance.
Nov 16 15:27:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-99668109-5943-4712-8282-4c7a4f0165b4 req-5a8a1b38-798f-4f77-98dd-4dde91633f1d service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Detach interface failed, port_id=50dd6861-3478-4da5-8700-f46bcf8cfdd4, reason: Instance 1ce290f3-7d0c-4475-8087-5c1e032893b6 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:16 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Deleted allocations for instance 1ce290f3-7d0c-4475-8087-5c1e032893b6
Nov 16 15:27:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-47b2f3b6-5e27-46a5-a0ca-519f8a778cda req-fc9f3a95-1f7a-469e-9798-37190240932e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-changed-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-47b2f3b6-5e27-46a5-a0ca-519f8a778cda req-fc9f3a95-1f7a-469e-9798-37190240932e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Refreshing instance network info cache due to event network-changed-d74fbdec-d4bb-4577-bcdc-5eec41374f07. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-47b2f3b6-5e27-46a5-a0ca-519f8a778cda req-fc9f3a95-1f7a-469e-9798-37190240932e service nova] Acquiring lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-47b2f3b6-5e27-46a5-a0ca-519f8a778cda req-fc9f3a95-1f7a-469e-9798-37190240932e service nova] Acquired lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-47b2f3b6-5e27-46a5-a0ca-519f8a778cda req-fc9f3a95-1f7a-469e-9798-37190240932e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Refreshing network info cache for port d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:27:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-618c0b92-c33e-40a3-84c8-02adb4d50558 tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.847s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:17 user nova-compute[74658]: DEBUG nova.network.neutron [req-47b2f3b6-5e27-46a5-a0ca-519f8a778cda req-fc9f3a95-1f7a-469e-9798-37190240932e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updated VIF entry in instance network info cache for port d74fbdec-d4bb-4577-bcdc-5eec41374f07. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:27:17 user nova-compute[74658]: DEBUG nova.network.neutron [req-47b2f3b6-5e27-46a5-a0ca-519f8a778cda req-fc9f3a95-1f7a-469e-9798-37190240932e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updating instance_info_cache with network_info: [{"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:27:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-47b2f3b6-5e27-46a5-a0ca-519f8a778cda req-fc9f3a95-1f7a-469e-9798-37190240932e service nova] Releasing lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:27:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-3ff1bd0e-ca17-4316-8ed5-3e1c2ef40137 req-92cdf9c7-f1a8-407a-abb8-b594631d7a0a service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Received event network-vif-plugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:27:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3ff1bd0e-ca17-4316-8ed5-3e1c2ef40137 req-92cdf9c7-f1a8-407a-abb8-b594631d7a0a service nova] Acquiring lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3ff1bd0e-ca17-4316-8ed5-3e1c2ef40137 req-92cdf9c7-f1a8-407a-abb8-b594631d7a0a service nova] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3ff1bd0e-ca17-4316-8ed5-3e1c2ef40137 req-92cdf9c7-f1a8-407a-abb8-b594631d7a0a service nova] Lock "1ce290f3-7d0c-4475-8087-5c1e032893b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-3ff1bd0e-ca17-4316-8ed5-3e1c2ef40137 req-92cdf9c7-f1a8-407a-abb8-b594631d7a0a service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] No waiting events found dispatching network-vif-plugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:27:17 user nova-compute[74658]: WARNING nova.compute.manager [req-3ff1bd0e-ca17-4316-8ed5-3e1c2ef40137 req-92cdf9c7-f1a8-407a-abb8-b594631d7a0a service nova] [instance: 1ce290f3-7d0c-4475-8087-5c1e032893b6] Received unexpected event network-vif-plugged-50dd6861-3478-4da5-8700-f46bcf8cfdd4 for instance with vm_state deleted and task_state None.
Nov 16 15:27:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-9d062572-b177-4709-9438-3fbbaddb01f2 req-8695a02e-2d5b-4725-b090-ed839a277237 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-changed-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:27:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-9d062572-b177-4709-9438-3fbbaddb01f2 req-8695a02e-2d5b-4725-b090-ed839a277237 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Refreshing instance network info cache due to event network-changed-d74fbdec-d4bb-4577-bcdc-5eec41374f07. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:27:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9d062572-b177-4709-9438-3fbbaddb01f2 req-8695a02e-2d5b-4725-b090-ed839a277237 service nova] Acquiring lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:27:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9d062572-b177-4709-9438-3fbbaddb01f2 req-8695a02e-2d5b-4725-b090-ed839a277237 service nova] Acquired lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:27:19 user nova-compute[74658]: DEBUG nova.network.neutron [req-9d062572-b177-4709-9438-3fbbaddb01f2 req-8695a02e-2d5b-4725-b090-ed839a277237 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Refreshing network info cache for port d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:27:20 user nova-compute[74658]: DEBUG nova.network.neutron [req-9d062572-b177-4709-9438-3fbbaddb01f2 req-8695a02e-2d5b-4725-b090-ed839a277237 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updated VIF entry in instance network info cache for port d74fbdec-d4bb-4577-bcdc-5eec41374f07. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:27:20 user nova-compute[74658]: DEBUG nova.network.neutron [req-9d062572-b177-4709-9438-3fbbaddb01f2 req-8695a02e-2d5b-4725-b090-ed839a277237 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updating instance_info_cache with network_info: [{"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:27:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9d062572-b177-4709-9438-3fbbaddb01f2 req-8695a02e-2d5b-4725-b090-ed839a277237 service nova] Releasing lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:27:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:22 user nova-compute[74658]: INFO nova.compute.manager [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Rebooting instance
Nov 16 15:27:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:27:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquired lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:27:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updating instance_info_cache with network_info: [{"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Releasing lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG nova.compute.manager [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-a142eb5a-434d-4577-af93-bdac065fb760 req-046983c8-7e73-4f7f-9b4f-7107e61b8802 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-vif-unplugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a142eb5a-434d-4577-af93-bdac065fb760 req-046983c8-7e73-4f7f-9b4f-7107e61b8802 service nova] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a142eb5a-434d-4577-af93-bdac065fb760 req-046983c8-7e73-4f7f-9b4f-7107e61b8802 service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a142eb5a-434d-4577-af93-bdac065fb760 req-046983c8-7e73-4f7f-9b4f-7107e61b8802 service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-a142eb5a-434d-4577-af93-bdac065fb760 req-046983c8-7e73-4f7f-9b4f-7107e61b8802 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] No waiting events found dispatching network-vif-unplugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:27:23 user nova-compute[74658]: WARNING nova.compute.manager [req-a142eb5a-434d-4577-af93-bdac065fb760 req-046983c8-7e73-4f7f-9b4f-7107e61b8802 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received unexpected event network-vif-unplugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 15:27:23 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Instance destroyed successfully.
Nov 16 15:27:23 user nova-compute[74658]: DEBUG nova.objects.instance [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'resources' on Instance uuid 38ff00d1-ed55-4b2e-8578-7d23241b14ae {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-815061819',display_name='tempest-TestMinimumBasicScenario-server-815061819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-815061819',id=23,image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdwvlnLLIm4nJfBEVS4gU9R+vVTf4AEKUWi4rXQcAbDUIvgksBJbbhGBylBHQTlNxwB5nPvGuYyloQbvUQheXMF4p00cira0X+myTFfLY/1UOCBmylgAYJ1qofW+bztkw==',key_name='tempest-TestMinimumBasicScenario-1953655943',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08549dcd4d26408098316f61ca4a6ee2',ramdisk_id='',reservation_id='r-nk6dncr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1910079629',owner_user_name='tempest-TestMinimumBasicScenario-1910079629-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:27:23Z,user_data=None,user_id='d3cee7d0742148a1808713d978dbd01b',uuid=38ff00d1-ed55-4b2e-8578-7d23241b14ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converting VIF {"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_vif [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd74fbdec-d4, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d448c093-060b-4942-ab56-0cf03e5ae1e6) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:24 user nova-compute[74658]: INFO os_vif [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4')
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qunzHBNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:27:24 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c24eca3-a102-4476-a88a-0019ff5e4c98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:27:24 user nova-compute[74658]: No targets found.
Nov 16 15:27:24 user nova-compute[74658]: iSNS:
Nov 16 15:27:24 user nova-compute[74658]: No targets found.
Nov 16 15:27:24 user nova-compute[74658]: STATIC:
Nov 16 15:27:24 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de
Nov 16 15:27:24 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:27:24 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:27:24 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7
Nov 16 15:27:24 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:27:24 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:27:24 user nova-compute[74658]: FIRMWARE:
Nov 16 15:27:24 user nova-compute[74658]: No targets found.
Nov 16 15:27:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:27:24 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:27:24 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[506cb201-a744-4e7c-9f3f-ebabd849b538]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[133855bc-1191-4c27-94b0-0d32821a66bf]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:24 user nova-compute[74658]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:27:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:24 user nova-compute[74658]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:27:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710125fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32062b-8404-4372-99f3-e071a9a6ed5c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a33160-4bb9-42ea-ba97-89061b6f3d60]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4e53b-6430-41fa-94b3-a5317055ab08]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3f7c9a-0bf5-48bc-a0cf-7b3dd0faacad]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa37a826-d925-4cbf-937a-06c740c556b8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff22b96-d8ca-4da1-9c49-f6cbb2a39915]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260]
Nov 16 15:27:24 user nova-compute[74658]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260] successful.
Nov 16 15:27:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9010195a-9d2b-4dc2-9ab8-63023d4ba983]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] <== disconnect_volume: return (303ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Start _get_guest_xml network_info=[{"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3dfb8e0c-e009-4134-8758-6224175b38b4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': '3dfb8e0c-e009-4134-8758-6224175b38b4'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'baa42509-a51a-49b8-a71f-b2740bd85bc0', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qunzHBNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '38ff00d1-ed55-4b2e-8578-7d23241b14ae', 'attached_at': '', 'detached_at': '', 'volume_id': '117377d1-2f4a-48cd-8a28-4374d1d9e9de', 'serial': '117377d1-2f4a-48cd-8a28-4374d1d9e9de'}, 'boot_index': None, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:27:24 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:27:24 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3dfb8e0c-e009-4134-8758-6224175b38b4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.objects.instance [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'vcpu_model' on Instance uuid 38ff00d1-ed55-4b2e-8578-7d23241b14ae {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.objects.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Object Instance<38ff00d1-ed55-4b2e-8578-7d23241b14ae> lazy-loaded attributes: resources,vcpu_model {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qunzHBNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:27:24 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:27:24 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:27:24 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[33306ee5-377f-4cc7-bd49-a21d8efbc0df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:27:24 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e518c6e8-64e5-4461-9492-197427b0e112]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de] added
Nov 16 15:27:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b5793c-974a-4f65-9075-55e7e8e334ff]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[484edadb-6647-473d-bb77-fe2b7e16dd78]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qunzHBNK {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qunzHBNK" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44993a4-5ef4-4af3-8fe6-9ee8cffeec14]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qunzHBNK'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b46f94d-9ac4-4ec8-b2c2-c0aec92a9a44]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4546811-34a0-4a11-87c1-e5f3238d22d4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9fa9ae-1cee-4eec-807b-0b29503e75b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260]
Nov 16 15:27:24 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260] successful.
Nov 16 15:27:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b661d06-825e-4a0d-80e6-1142145673e8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa16ebd7-1eda-4dc3-a2a7-070a2bcb3529]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:24 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:27:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:27:24 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:27:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b80088-77ae-43ca-96af-287724cf7812]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-49e4bca1-5555-4236-a899-87e38d286a26 req-a416d2c0-f754-4776-905f-21a792c06e76 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-49e4bca1-5555-4236-a899-87e38d286a26 req-a416d2c0-f754-4776-905f-21a792c06e76 service nova] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-49e4bca1-5555-4236-a899-87e38d286a26 req-a416d2c0-f754-4776-905f-21a792c06e76 service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-49e4bca1-5555-4236-a899-87e38d286a26 req-a416d2c0-f754-4776-905f-21a792c06e76 service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-49e4bca1-5555-4236-a899-87e38d286a26 req-a416d2c0-f754-4776-905f-21a792c06e76 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] No waiting events found dispatching network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:27:25 user nova-compute[74658]: WARNING nova.compute.manager [req-49e4bca1-5555-4236-a899-87e38d286a26 req-a416d2c0-f754-4776-905f-21a792c06e76 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received unexpected event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 15:27:25 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qunzHBNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23039623836333264', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039623836333264', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-815061819',display_name='tempest-TestMinimumBasicScenario-server-815061819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-815061819',id=23,image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdwvlnLLIm4nJfBEVS4gU9R+vVTf4AEKUWi4rXQcAbDUIvgksBJbbhGBylBHQTlNxwB5nPvGuYyloQbvUQheXMF4p00cira0X+myTFfLY/1UOCBmylgAYJ1qofW+bztkw==',key_name='tempest-TestMinimumBasicScenario-1953655943',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08549dcd4d26408098316f61ca4a6ee2',ramdisk_id='',reservation_id='r-nk6dncr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1910079629',owner_user_name='tempest-TestMinimumBasicScenario-1910079629-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:27:23Z,user_data=None,user_id='d3cee7d0742148a1808713d978dbd01b',uuid=38ff00d1-ed55-4b2e-8578-7d23241b14ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converting VIF {"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG nova.objects.instance [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'pci_devices' on Instance uuid 38ff00d1-ed55-4b2e-8578-7d23241b14ae {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG nova.objects.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Object Instance<38ff00d1-ed55-4b2e-8578-7d23241b14ae> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:27:25 user nova-compute[74658]:   <uuid>38ff00d1-ed55-4b2e-8578-7d23241b14ae</uuid>
Nov 16 15:27:25 user nova-compute[74658]:   <name>instance-00000017</name>
Nov 16 15:27:25 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:27:25 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:27:25 user nova-compute[74658]:   <metadata>
Nov 16 15:27:25 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:27:25 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:27:25 user nova-compute[74658]:       <nova:name>tempest-TestMinimumBasicScenario-server-815061819</nova:name>
Nov 16 15:27:25 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:27:24</nova:creationTime>
Nov 16 15:27:25 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:27:25 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:27:25 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:27:25 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:27:25 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:27:25 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:27:25 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:27:25 user nova-compute[74658]:       <nova:owner>
Nov 16 15:27:25 user nova-compute[74658]:         <nova:user uuid="d3cee7d0742148a1808713d978dbd01b">tempest-TestMinimumBasicScenario-1910079629-project-member</nova:user>
Nov 16 15:27:25 user nova-compute[74658]:         <nova:project uuid="08549dcd4d26408098316f61ca4a6ee2">tempest-TestMinimumBasicScenario-1910079629</nova:project>
Nov 16 15:27:25 user nova-compute[74658]:       </nova:owner>
Nov 16 15:27:25 user nova-compute[74658]:       <nova:root type="image" uuid="3dfb8e0c-e009-4134-8758-6224175b38b4"/>
Nov 16 15:27:25 user nova-compute[74658]:       <nova:ports>
Nov 16 15:27:25 user nova-compute[74658]:         <nova:port uuid="d74fbdec-d4bb-4577-bcdc-5eec41374f07">
Nov 16 15:27:25 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 15:27:25 user nova-compute[74658]:         </nova:port>
Nov 16 15:27:25 user nova-compute[74658]:       </nova:ports>
Nov 16 15:27:25 user nova-compute[74658]:     </nova:instance>
Nov 16 15:27:25 user nova-compute[74658]:   </metadata>
Nov 16 15:27:25 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:27:25 user nova-compute[74658]:     <system>
Nov 16 15:27:25 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:27:25 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:27:25 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:27:25 user nova-compute[74658]:       <entry name="serial">38ff00d1-ed55-4b2e-8578-7d23241b14ae</entry>
Nov 16 15:27:25 user nova-compute[74658]:       <entry name="uuid">38ff00d1-ed55-4b2e-8578-7d23241b14ae</entry>
Nov 16 15:27:25 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:27:25 user nova-compute[74658]:     </system>
Nov 16 15:27:25 user nova-compute[74658]:   </sysinfo>
Nov 16 15:27:25 user nova-compute[74658]:   <os>
Nov 16 15:27:25 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:27:25 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:27:25 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:27:25 user nova-compute[74658]:   </os>
Nov 16 15:27:25 user nova-compute[74658]:   <features>
Nov 16 15:27:25 user nova-compute[74658]:     <acpi/>
Nov 16 15:27:25 user nova-compute[74658]:     <apic/>
Nov 16 15:27:25 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:27:25 user nova-compute[74658]:   </features>
Nov 16 15:27:25 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:27:25 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:27:25 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:27:25 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:27:25 user nova-compute[74658]:   </clock>
Nov 16 15:27:25 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:27:25 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:27:25 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:27:25 user nova-compute[74658]:   </cpu>
Nov 16 15:27:25 user nova-compute[74658]:   <devices>
Nov 16 15:27:25 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:27:25 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:27:25 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk"/>
Nov 16 15:27:25 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:27:25 user nova-compute[74658]:     </disk>
Nov 16 15:27:25 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:27:25 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:27:25 user nova-compute[74658]:       <source dev="/dev/sdc"/>
Nov 16 15:27:25 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:27:25 user nova-compute[74658]:       <serial>117377d1-2f4a-48cd-8a28-4374d1d9e9de</serial>
Nov 16 15:27:25 user nova-compute[74658]:     </disk>
Nov 16 15:27:25 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:27:25 user nova-compute[74658]:       <mac address="fa:16:3e:48:94:b9"/>
Nov 16 15:27:25 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:27:25 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:27:25 user nova-compute[74658]:       <target dev="tapd74fbdec-d4"/>
Nov 16 15:27:25 user nova-compute[74658]:     </interface>
Nov 16 15:27:25 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:27:25 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/console.log" append="off"/>
Nov 16 15:27:25 user nova-compute[74658]:     </serial>
Nov 16 15:27:25 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:27:25 user nova-compute[74658]:     <video>
Nov 16 15:27:25 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:27:25 user nova-compute[74658]:     </video>
Nov 16 15:27:25 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:27:25 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:27:25 user nova-compute[74658]:     </rng>
Nov 16 15:27:25 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:27:25 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:27:25 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:27:25 user nova-compute[74658]:     </memballoon>
Nov 16 15:27:25 user nova-compute[74658]:   </devices>
Nov 16 15:27:25 user nova-compute[74658]: </domain>
Nov 16 15:27:25 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:27:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG nova.objects.instance [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'trusted_certs' on Instance uuid 38ff00d1-ed55-4b2e-8578-7d23241b14ae {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG nova.objects.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Object Instance<38ff00d1-ed55-4b2e-8578-7d23241b14ae> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746 --force-share --output=json" returned: 0 in 0.196s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Cannot resize image /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG nova.objects.instance [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'migration_context' on Instance uuid 38ff00d1-ed55-4b2e-8578-7d23241b14ae {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG nova.objects.base [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Object Instance<38ff00d1-ed55-4b2e-8578-7d23241b14ae> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-815061819',display_name='tempest-TestMinimumBasicScenario-server-815061819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-815061819',id=23,image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdwvlnLLIm4nJfBEVS4gU9R+vVTf4AEKUWi4rXQcAbDUIvgksBJbbhGBylBHQTlNxwB5nPvGuYyloQbvUQheXMF4p00cira0X+myTFfLY/1UOCBmylgAYJ1qofW+bztkw==',key_name='tempest-TestMinimumBasicScenario-1953655943',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='08549dcd4d26408098316f61ca4a6ee2',ramdisk_id='',reservation_id='r-nk6dncr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1910079629',owner_user_name='tempest-TestMinimumBasicScenario-1910079629-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:27:23Z,user_data=None,user_id='d3cee7d0742148a1808713d978dbd01b',uuid=38ff00d1-ed55-4b2e-8578-7d23241b14ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converting VIF {"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG os_vif [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '710ab8ce-a7b8-5cd4-ab74-d420c39fc90a', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd74fbdec-d4, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd74fbdec-d4, col_values=(('qos', UUID('c62f7705-05d7-425f-9778-b05d09f89acd')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd74fbdec-d4, col_values=(('external_ids', {'iface-id': 'd74fbdec-d4bb-4577-bcdc-5eec41374f07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:94:b9', 'vm-uuid': '38ff00d1-ed55-4b2e-8578-7d23241b14ae'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:27:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:26 user nova-compute[74658]: INFO os_vif [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4')
Nov 16 15:27:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-a11edd0a-3957-40ee-b861-bcacdeda3633 req-7767b6f7-1dc4-41e3-9909-888e42e1e373 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:27:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a11edd0a-3957-40ee-b861-bcacdeda3633 req-7767b6f7-1dc4-41e3-9909-888e42e1e373 service nova] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a11edd0a-3957-40ee-b861-bcacdeda3633 req-7767b6f7-1dc4-41e3-9909-888e42e1e373 service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a11edd0a-3957-40ee-b861-bcacdeda3633 req-7767b6f7-1dc4-41e3-9909-888e42e1e373 service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-a11edd0a-3957-40ee-b861-bcacdeda3633 req-7767b6f7-1dc4-41e3-9909-888e42e1e373 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] No waiting events found dispatching network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:27:28 user nova-compute[74658]: WARNING nova.compute.manager [req-a11edd0a-3957-40ee-b861-bcacdeda3633 req-7767b6f7-1dc4-41e3-9909-888e42e1e373 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received unexpected event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 15:27:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:27:30 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Instance rebooted successfully.
Nov 16 15:27:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:27:30 user nova-compute[74658]: DEBUG nova.compute.manager [req-bd06e352-e133-40a5-b26c-b8b7496daaf0 req-fbda2518-802f-4208-85dd-9366b9dd838c service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:27:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bd06e352-e133-40a5-b26c-b8b7496daaf0 req-fbda2518-802f-4208-85dd-9366b9dd838c service nova] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bd06e352-e133-40a5-b26c-b8b7496daaf0 req-fbda2518-802f-4208-85dd-9366b9dd838c service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bd06e352-e133-40a5-b26c-b8b7496daaf0 req-fbda2518-802f-4208-85dd-9366b9dd838c service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:30 user nova-compute[74658]: DEBUG nova.compute.manager [req-bd06e352-e133-40a5-b26c-b8b7496daaf0 req-fbda2518-802f-4208-85dd-9366b9dd838c service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] No waiting events found dispatching network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:27:30 user nova-compute[74658]: WARNING nova.compute.manager [req-bd06e352-e133-40a5-b26c-b8b7496daaf0 req-fbda2518-802f-4208-85dd-9366b9dd838c service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received unexpected event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 15:27:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-989ba3b5-e2d6-46f3-86be-1edf55e94f70 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.988s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:27:57 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:27:57 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 15:27:58 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:27:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "5834c073-5392-40f8-bd69-8e7b50cd42ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:58 user nova-compute[74658]: DEBUG nova.compute.manager [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:27:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:27:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:27:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:27:58 user nova-compute[74658]: INFO nova.compute.claims [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Claim successful on node user
Nov 16 15:27:58 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:27:58 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG nova.network.neutron [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:27:59 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:27:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG nova.policy [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aed7ea9505b3400ebbe1ce456419bc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2156886e7c2247e38a1ffe4025798a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:27:59 user nova-compute[74658]: INFO nova.virt.block_device [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Booting with volume 2b28b487-225d-4391-a815-1de3cfb17e11 at /dev/vda
Nov 16 15:27:59 user nova-compute[74658]: DEBUG os_brick.utils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[274613ad-45c8-4f6c-977b-d461339f4a9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d73f066-a254-4a03-a1d8-d79914d3c8d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0b2713-0eef-404f-9d81-8f6610a43860]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[120d4aee-4074-413e-9587-452b7b095e1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:27:59 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:27:59 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f3ba44-fde6-4510-94a3-c1acc0c8a987]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG os_brick.utils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Updating existing volume attachment record: 9529aaf1-f3e7-46ec-b381-0532fa2a838b {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:27:59 user nova-compute[74658]: DEBUG nova.network.neutron [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Successfully created port: 2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Successfully updated port: 2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "refresh_cache-5834c073-5392-40f8-bd69-8e7b50cd42ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquired lock "refresh_cache-5834c073-5392-40f8-bd69-8e7b50cd42ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-a56c287c-fccc-4acf-96ff-a4161fd33392 req-193ae487-3626-4dda-89c5-578a3a427d07 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Received event network-changed-2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-a56c287c-fccc-4acf-96ff-a4161fd33392 req-193ae487-3626-4dda-89c5-578a3a427d07 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Refreshing instance network info cache due to event network-changed-2194e788-132c-48bc-a46b-15b811535723. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a56c287c-fccc-4acf-96ff-a4161fd33392 req-193ae487-3626-4dda-89c5-578a3a427d07 service nova] Acquiring lock "refresh_cache-5834c073-5392-40f8-bd69-8e7b50cd42ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Updating instance_info_cache with network_info: [{"id": "2194e788-132c-48bc-a46b-15b811535723", "address": "fa:16:3e:cc:f7:ca", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2194e788-13", "ovs_interfaceid": "2194e788-132c-48bc-a46b-15b811535723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Releasing lock "refresh_cache-5834c073-5392-40f8-bd69-8e7b50cd42ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Instance network_info: |[{"id": "2194e788-132c-48bc-a46b-15b811535723", "address": "fa:16:3e:cc:f7:ca", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2194e788-13", "ovs_interfaceid": "2194e788-132c-48bc-a46b-15b811535723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a56c287c-fccc-4acf-96ff-a4161fd33392 req-193ae487-3626-4dda-89c5-578a3a427d07 service nova] Acquired lock "refresh_cache-5834c073-5392-40f8-bd69-8e7b50cd42ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:28:00 user nova-compute[74658]: DEBUG nova.network.neutron [req-a56c287c-fccc-4acf-96ff-a4161fd33392 req-193ae487-3626-4dda-89c5-578a3a427d07 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Refreshing network info cache for port 2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:28:01 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:28:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:28:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 15:28:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-a56c287c-fccc-4acf-96ff-a4161fd33392 req-193ae487-3626-4dda-89c5-578a3a427d07 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Updated VIF entry in instance network info cache for port 2194e788-132c-48bc-a46b-15b811535723. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:28:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-a56c287c-fccc-4acf-96ff-a4161fd33392 req-193ae487-3626-4dda-89c5-578a3a427d07 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Updating instance_info_cache with network_info: [{"id": "2194e788-132c-48bc-a46b-15b811535723", "address": "fa:16:3e:cc:f7:ca", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2194e788-13", "ovs_interfaceid": "2194e788-132c-48bc-a46b-15b811535723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:28:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a56c287c-fccc-4acf-96ff-a4161fd33392 req-193ae487-3626-4dda-89c5-578a3a427d07 service nova] Releasing lock "refresh_cache-5834c073-5392-40f8-bd69-8e7b50cd42ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:28:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:28:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:28:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Creating image(s)
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Ensure instance console log exists: /opt/stack/data/nova/instances/5834c073-5392-40f8-bd69-8e7b50cd42ba/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Start _get_guest_xml network_info=[{"id": "2194e788-132c-48bc-a46b-15b811535723", "address": "fa:16:3e:cc:f7:ca", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2194e788-13", "ovs_interfaceid": "2194e788-132c-48bc-a46b-15b811535723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9529aaf1-f3e7-46ec-b381-0532fa2a838b', 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XwKTauQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5834c073-5392-40f8-bd69-8e7b50cd42ba', 'attached_at': '', 'detached_at': '', 'volume_id': '2b28b487-225d-4391-a815-1de3cfb17e11', 'serial': '2b28b487-225d-4391-a815-1de3cfb17e11'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:28:04 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:28:04 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XwKTauQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:28:04 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:28:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:28:04 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:28:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:28:04 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675cfa6-9644-406d-93ff-9862ac6b7b6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:28:04 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[05120891-5fac-4416-9bfb-d1c79f2937ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11] added
Nov 16 15:28:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[871ad456-52e6-4595-874f-22450212601d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a81d11d-0f15-434f-ad9f-df37fdc2f220]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XwKTauQM {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XwKTauQM" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b624ea98-6370-4862-bdf2-0739de63a7d2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XwKTauQM'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:05 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:28:05 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8182MB free_disk=25.346633911132812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a2dfaf-21e3-4205-8a05-e9617e8b3eb3]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e3ab23-f114-4f9d-b554-d2f34396bed0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:05 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:05 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:05 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:05 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f7aea8-2a74-4b1d-897d-864c489b22d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11, portal: 172.16.0.220,3260]
Nov 16 15:28:05 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11, portal: 172.16.0.220,3260] successful.
Nov 16 15:28:05 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7a35e2-e74b-4bcb-ac88-b530329b865d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2a186d-3a47-4e2c-b987-d01b6c766f66]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:05 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:05 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:05 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:05 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:05 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:05 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.626s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a351cef-4e4a-4a6c-b90d-6487cdf062cd]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XwKTauQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance bf2fe627-5a1c-44f0-b872-1d4275baac59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6c8dd806-c294-40dd-a13d-63659a1d5669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 97135af5-e020-482b-a54b-6cf30a5443d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance f314ad85-524a-4326-bdd5-2c7c4de78690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 5834c073-5392-40f8-bd69-8e7b50cd42ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 15:28:05 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.660s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== connect_volume: return (1662ms) {'type': 'block', 'scsi_wwn': '26162353763393334', 'path': '/dev/sdd'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162353763393334', 'path': '/dev/sdd'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-458537493',display_name='tempest-TestVolumeBootPattern-volume-backed-server-458537493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-458537493',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP04IvCYiOc30SwZSrR1Ch1Y0etfWIedgQUPmkgdcQXSkp73KTfQmWNkI7UjB5yFakwfymdG7UyOzIOxHSufcYbRkPfow9IgHTNl+4ly7jflH4yng83e2i3xKCvM2IBBQ==',key_name='tempest-keypair-420977997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-5zgrq0x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=5834c073-5392-40f8-bd69-8e7b50cd42ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2194e788-132c-48bc-a46b-15b811535723", "address": "fa:16:3e:cc:f7:ca", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2194e788-13", "ovs_interfaceid": "2194e788-132c-48bc-a46b-15b811535723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "2194e788-132c-48bc-a46b-15b811535723", "address": "fa:16:3e:cc:f7:ca", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2194e788-13", "ovs_interfaceid": "2194e788-132c-48bc-a46b-15b811535723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f7:ca,bridge_name='br-int',has_traffic_filtering=True,id=2194e788-132c-48bc-a46b-15b811535723,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2194e788-13') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.objects.instance [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'pci_devices' on Instance uuid 5834c073-5392-40f8-bd69-8e7b50cd42ba {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:28:06 user nova-compute[74658]:   <uuid>5834c073-5392-40f8-bd69-8e7b50cd42ba</uuid>
Nov 16 15:28:06 user nova-compute[74658]:   <name>instance-0000001b</name>
Nov 16 15:28:06 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:28:06 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:28:06 user nova-compute[74658]:   <metadata>
Nov 16 15:28:06 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:28:06 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:28:06 user nova-compute[74658]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-458537493</nova:name>
Nov 16 15:28:06 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:28:04</nova:creationTime>
Nov 16 15:28:06 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:28:06 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:28:06 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:28:06 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:28:06 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:28:06 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:28:06 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:28:06 user nova-compute[74658]:       <nova:owner>
Nov 16 15:28:06 user nova-compute[74658]:         <nova:user uuid="aed7ea9505b3400ebbe1ce456419bc82">tempest-TestVolumeBootPattern-1853010836-project-member</nova:user>
Nov 16 15:28:06 user nova-compute[74658]:         <nova:project uuid="2156886e7c2247e38a1ffe4025798a96">tempest-TestVolumeBootPattern-1853010836</nova:project>
Nov 16 15:28:06 user nova-compute[74658]:       </nova:owner>
Nov 16 15:28:06 user nova-compute[74658]:       <nova:ports>
Nov 16 15:28:06 user nova-compute[74658]:         <nova:port uuid="2194e788-132c-48bc-a46b-15b811535723">
Nov 16 15:28:06 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 15:28:06 user nova-compute[74658]:         </nova:port>
Nov 16 15:28:06 user nova-compute[74658]:       </nova:ports>
Nov 16 15:28:06 user nova-compute[74658]:     </nova:instance>
Nov 16 15:28:06 user nova-compute[74658]:   </metadata>
Nov 16 15:28:06 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:28:06 user nova-compute[74658]:     <system>
Nov 16 15:28:06 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:28:06 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:28:06 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:28:06 user nova-compute[74658]:       <entry name="serial">5834c073-5392-40f8-bd69-8e7b50cd42ba</entry>
Nov 16 15:28:06 user nova-compute[74658]:       <entry name="uuid">5834c073-5392-40f8-bd69-8e7b50cd42ba</entry>
Nov 16 15:28:06 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:28:06 user nova-compute[74658]:     </system>
Nov 16 15:28:06 user nova-compute[74658]:   </sysinfo>
Nov 16 15:28:06 user nova-compute[74658]:   <os>
Nov 16 15:28:06 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:28:06 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:28:06 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:28:06 user nova-compute[74658]:   </os>
Nov 16 15:28:06 user nova-compute[74658]:   <features>
Nov 16 15:28:06 user nova-compute[74658]:     <acpi/>
Nov 16 15:28:06 user nova-compute[74658]:     <apic/>
Nov 16 15:28:06 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:28:06 user nova-compute[74658]:   </features>
Nov 16 15:28:06 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:28:06 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:28:06 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:28:06 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:28:06 user nova-compute[74658]:   </clock>
Nov 16 15:28:06 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:28:06 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:28:06 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:28:06 user nova-compute[74658]:   </cpu>
Nov 16 15:28:06 user nova-compute[74658]:   <devices>
Nov 16 15:28:06 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:28:06 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:28:06 user nova-compute[74658]:       <source dev="/dev/sdd"/>
Nov 16 15:28:06 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:28:06 user nova-compute[74658]:       <serial>2b28b487-225d-4391-a815-1de3cfb17e11</serial>
Nov 16 15:28:06 user nova-compute[74658]:     </disk>
Nov 16 15:28:06 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:28:06 user nova-compute[74658]:       <mac address="fa:16:3e:cc:f7:ca"/>
Nov 16 15:28:06 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:28:06 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:28:06 user nova-compute[74658]:       <target dev="tap2194e788-13"/>
Nov 16 15:28:06 user nova-compute[74658]:     </interface>
Nov 16 15:28:06 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:28:06 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/5834c073-5392-40f8-bd69-8e7b50cd42ba/console.log" append="off"/>
Nov 16 15:28:06 user nova-compute[74658]:     </serial>
Nov 16 15:28:06 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:28:06 user nova-compute[74658]:     <video>
Nov 16 15:28:06 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:28:06 user nova-compute[74658]:     </video>
Nov 16 15:28:06 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:28:06 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:28:06 user nova-compute[74658]:     </rng>
Nov 16 15:28:06 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:28:06 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:28:06 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:28:06 user nova-compute[74658]:     </memballoon>
Nov 16 15:28:06 user nova-compute[74658]:   </devices>
Nov 16 15:28:06 user nova-compute[74658]: </domain>
Nov 16 15:28:06 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-458537493',display_name='tempest-TestVolumeBootPattern-volume-backed-server-458537493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-458537493',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP04IvCYiOc30SwZSrR1Ch1Y0etfWIedgQUPmkgdcQXSkp73KTfQmWNkI7UjB5yFakwfymdG7UyOzIOxHSufcYbRkPfow9IgHTNl+4ly7jflH4yng83e2i3xKCvM2IBBQ==',key_name='tempest-keypair-420977997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-5zgrq0x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=5834c073-5392-40f8-bd69-8e7b50cd42ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2194e788-132c-48bc-a46b-15b811535723", "address": "fa:16:3e:cc:f7:ca", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2194e788-13", "ovs_interfaceid": "2194e788-132c-48bc-a46b-15b811535723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "2194e788-132c-48bc-a46b-15b811535723", "address": "fa:16:3e:cc:f7:ca", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2194e788-13", "ovs_interfaceid": "2194e788-132c-48bc-a46b-15b811535723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f7:ca,bridge_name='br-int',has_traffic_filtering=True,id=2194e788-132c-48bc-a46b-15b811535723,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2194e788-13') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG os_vif [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f7:ca,bridge_name='br-int',has_traffic_filtering=True,id=2194e788-132c-48bc-a46b-15b811535723,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2194e788-13') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '206f7811-f4df-55dd-92a2-fe816089f779', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2194e788-13, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2194e788-13, col_values=(('qos', UUID('dbaba91b-b84b-4200-a278-bad5c6b2026d')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2194e788-13, col_values=(('external_ids', {'iface-id': '2194e788-132c-48bc-a46b-15b811535723', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:f7:ca', 'vm-uuid': '5834c073-5392-40f8-bd69-8e7b50cd42ba'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:06 user nova-compute[74658]: INFO os_vif [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f7:ca,bridge_name='br-int',has_traffic_filtering=True,id=2194e788-132c-48bc-a46b-15b811535723,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2194e788-13')
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:28:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No VIF found with MAC fa:16:3e:cc:f7:ca, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-539331f7-c37b-4ecb-b362-4f8d61eee2ee req-3e41cada-a6d1-42f2-87f2-177fa83802fe service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Received event network-vif-plugged-2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-539331f7-c37b-4ecb-b362-4f8d61eee2ee req-3e41cada-a6d1-42f2-87f2-177fa83802fe service nova] Acquiring lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-539331f7-c37b-4ecb-b362-4f8d61eee2ee req-3e41cada-a6d1-42f2-87f2-177fa83802fe service nova] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-539331f7-c37b-4ecb-b362-4f8d61eee2ee req-3e41cada-a6d1-42f2-87f2-177fa83802fe service nova] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-539331f7-c37b-4ecb-b362-4f8d61eee2ee req-3e41cada-a6d1-42f2-87f2-177fa83802fe service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] No waiting events found dispatching network-vif-plugged-2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:28:08 user nova-compute[74658]: WARNING nova.compute.manager [req-539331f7-c37b-4ecb-b362-4f8d61eee2ee req-3e41cada-a6d1-42f2-87f2-177fa83802fe service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Received unexpected event network-vif-plugged-2194e788-132c-48bc-a46b-15b811535723 for instance with vm_state building and task_state spawning.
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:08 user nova-compute[74658]: INFO nova.compute.manager [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Terminating instance
Nov 16 15:28:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 15:28:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Instance destroyed successfully.
Nov 16 15:28:09 user nova-compute[74658]: DEBUG nova.objects.instance [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lazy-loading 'resources' on Instance uuid bf2fe627-5a1c-44f0-b872-1d4275baac59 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1678539302',display_name='tempest-VolumesAdminNegativeTest-server-1678539302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1678539302',id=19,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1xTGVdXg/QKOPV1EjYpFjfnQePma3USIAuLeMzqREuyJ/PC1prOpr8tw1rMXP7AeG5Q6E5DOhRAjfYTjDeogagQ8e6JuJes6RgDig75m2ILlV7ivV3JpaQc3oon8FpXg==',key_name='tempest-keypair-1679391218',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80b1b7e5c218402b9575db3d0cde0396',ramdisk_id='',reservation_id='r-zica6mwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2132519312',owner_user_name='tempest-VolumesAdminNegativeTest-2132519312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:22:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='273f88233c0341b8a43761f45b3d9c82',uuid=bf2fe627-5a1c-44f0-b872-1d4275baac59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converting VIF {"id": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "address": "fa:16:3e:0b:1e:bd", "network": {"id": "857e5916-55f6-49a4-a52d-3323f4fdcf34", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977907504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80b1b7e5c218402b9575db3d0cde0396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab836cbe-d4", "ovs_interfaceid": "ab836cbe-d4b9-43bc-bee5-bd37dd08ba40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:1e:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab836cbe-d4b9-43bc-bee5-bd37dd08ba40,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab836cbe-d4') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG os_vif [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:1e:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab836cbe-d4b9-43bc-bee5-bd37dd08ba40,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab836cbe-d4') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab836cbe-d4, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cd91173-c0b3-463a-821f-d0869411482b) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:09 user nova-compute[74658]: INFO os_vif [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:1e:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab836cbe-d4b9-43bc-bee5-bd37dd08ba40,network=Network(857e5916-55f6-49a4-a52d-3323f4fdcf34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab836cbe-d4')
Nov 16 15:28:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Deleting instance files /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59_del
Nov 16 15:28:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Deletion of /opt/stack/data/nova/instances/bf2fe627-5a1c-44f0-b872-1d4275baac59_del complete
Nov 16 15:28:09 user nova-compute[74658]: INFO nova.compute.manager [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 15:28:09 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:28:10 user nova-compute[74658]: INFO nova.compute.claims [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Claim successful on node user
Nov 16 15:28:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:28:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Instance spawned successfully.
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Received event network-vif-plugged-2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] Acquiring lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] No waiting events found dispatching network-vif-plugged-2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:28:10 user nova-compute[74658]: WARNING nova.compute.manager [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Received unexpected event network-vif-plugged-2194e788-132c-48bc-a46b-15b811535723 for instance with vm_state building and task_state spawning.
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Received event network-vif-unplugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] Acquiring lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] No waiting events found dispatching network-vif-unplugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Received event network-vif-unplugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Received event network-vif-plugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] Acquiring lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] No waiting events found dispatching network-vif-plugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:28:10 user nova-compute[74658]: WARNING nova.compute.manager [req-392cf907-72d2-4543-a13c-bc8ec825c2aa req-af142553-8a8d-43cd-9cb0-c9a32a55f196 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Received unexpected event network-vif-plugged-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 for instance with vm_state active and task_state deleting.
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:28:10 user nova-compute[74658]: INFO nova.compute.manager [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:28:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:28:10 user nova-compute[74658]: INFO nova.compute.manager [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Took 11.88 seconds to build instance.
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-584cb01e-6afb-47ad-9897-3a562f2a9f5b tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.981s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.policy [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ed5db501b2e4dcfb742e18dfdeae88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621284eebf704320bacac96aedbc77a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:28:10 user nova-compute[74658]: INFO nova.virt.block_device [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Booting with volume-backed-image aca440dd-4b6f-4e54-990c-d8198a375081 at /dev/vda
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:28:10 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Took 0.97 seconds to deallocate network for instance.
Nov 16 15:28:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-c5daeeb6-3940-43f9-b772-975f5f33cc55 req-59169042-a0c7-4f30-aef5-9f738ab4dd20 service nova] [instance: bf2fe627-5a1c-44f0-b872-1d4275baac59] Received event network-vif-deleted-ab836cbe-d4b9-43bc-bee5-bd37dd08ba40 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:11 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:28:11 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:28:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:11 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Deleted allocations for instance bf2fe627-5a1c-44f0-b872-1d4275baac59
Nov 16 15:28:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cd97e813-014b-413b-ac4b-467ecf4a125d tempest-VolumesAdminNegativeTest-2132519312 tempest-VolumesAdminNegativeTest-2132519312-project-member] Lock "bf2fe627-5a1c-44f0-b872-1d4275baac59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.552s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Successfully created port: 54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Successfully updated port: 54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquired lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-14c86ff5-adce-4b5b-841e-20791b4cb1e5 req-943b9be1-b370-4642-864c-1becbce14cf2 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-changed-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-14c86ff5-adce-4b5b-841e-20791b4cb1e5 req-943b9be1-b370-4642-864c-1becbce14cf2 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Refreshing instance network info cache due to event network-changed-54c165cd-1a44-4017-9b20-e2d1ebc02101. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-14c86ff5-adce-4b5b-841e-20791b4cb1e5 req-943b9be1-b370-4642-864c-1becbce14cf2 service nova] Acquiring lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Updating instance_info_cache with network_info: [{"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Releasing lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Instance network_info: |[{"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-14c86ff5-adce-4b5b-841e-20791b4cb1e5 req-943b9be1-b370-4642-864c-1becbce14cf2 service nova] Acquired lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG nova.network.neutron [req-14c86ff5-adce-4b5b-841e-20791b4cb1e5 req-943b9be1-b370-4642-864c-1becbce14cf2 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Refreshing network info cache for port 54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG nova.network.neutron [req-14c86ff5-adce-4b5b-841e-20791b4cb1e5 req-943b9be1-b370-4642-864c-1becbce14cf2 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Updated VIF entry in instance network info cache for port 54c165cd-1a44-4017-9b20-e2d1ebc02101. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG nova.network.neutron [req-14c86ff5-adce-4b5b-841e-20791b4cb1e5 req-943b9be1-b370-4642-864c-1becbce14cf2 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Updating instance_info_cache with network_info: [{"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:28:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-14c86ff5-adce-4b5b-841e-20791b4cb1e5 req-943b9be1-b370-4642-864c-1becbce14cf2 service nova] Releasing lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:28:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG os_brick.utils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[599d2ee5-e272-4c89-8d3d-726787539bf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[48da06a5-b519-4d69-997b-4542a06a7338]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[30db5a17-8050-4b47-8175-e05fd288cc0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e07114-d835-47a3-911a-aec05061652f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:28:16 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:28:16 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4ea940-d389-4dd0-a87d-72a7a58d9dfe]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG os_brick.utils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:28:16 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Updating existing volume attachment record: 5ba6a205-3579-4422-95e3-18b0671c3ec8 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:28:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:28:21 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Creating image(s)
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Ensure instance console log exists: /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Start _get_guest_xml network_info=[{"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5ba6a205-3579-4422-95e3-18b0671c3ec8', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhZyDBUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b6a0ca45-19d0-4644-8e65-fe904d85e1c1', 'attached_at': '', 'detached_at': '', 'volume_id': '5443b744-0bfd-453d-b6e9-c4a54605cb44', 'serial': '5443b744-0bfd-453d-b6e9-c4a54605cb44'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:28:21 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:28:21 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhZyDBUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:28:21 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:28:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:28:21 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:28:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:28:21 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5890557a-c586-45ec-a865-b252891575ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:28:21 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[81277329-f166-4cbc-a6a4-d2fe501c98c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44] added
Nov 16 15:28:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[259c9773-8533-41db-923f-78f9d49f1073]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d91f40-2305-450f-97b9-e8f57d853ff5]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhZyDBUP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhZyDBUP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5069eb-4a6c-4f08-bdca-53dd668879b5]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bhZyDBUP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8548191a-dfcc-4ba4-bbd4-ccb27c024b5b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc6420b-91ca-4340-992d-105173c7be32]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:22 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:22 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:22 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:22 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c66531-cac9-47f8-aa29-669ae3919f7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44, portal: 172.16.0.220,3260]
Nov 16 15:28:22 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44, portal: 172.16.0.220,3260] successful.
Nov 16 15:28:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd9b967-21b5-4847-a257-bff70cf04385]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8bee09-aa09-4888-b29f-530f84cc7b2c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:22 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:22 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:22 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:22 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:22 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:22 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72df8ab-76d7-4d55-99c4-516585e9fcb0]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:22 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhZyDBUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26331316135306235', 'path': '/dev/sde'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331316135306235', 'path': '/dev/sde'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2014300948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2014300948',id=28,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621284eebf704320bacac96aedbc77a4',ramdisk_id='',reservation_id='r-ttx4gd15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:28:11Z,user_data=None,user_id='6ed5db501b2e4dcfb742e18dfdeae88b',uuid=b6a0ca45-19d0-4644-8e65-fe904d85e1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converting VIF {"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=54c165cd-1a44-4017-9b20-e2d1ebc02101,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c165cd-1a') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG nova.objects.instance [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'pci_devices' on Instance uuid b6a0ca45-19d0-4644-8e65-fe904d85e1c1 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:28:23 user nova-compute[74658]:   <uuid>b6a0ca45-19d0-4644-8e65-fe904d85e1c1</uuid>
Nov 16 15:28:23 user nova-compute[74658]:   <name>instance-0000001c</name>
Nov 16 15:28:23 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:28:23 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:28:23 user nova-compute[74658]:   <metadata>
Nov 16 15:28:23 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:28:23 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:28:23 user nova-compute[74658]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2014300948</nova:name>
Nov 16 15:28:23 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:28:21</nova:creationTime>
Nov 16 15:28:23 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:28:23 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:28:23 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:28:23 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:28:23 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:28:23 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:28:23 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:28:23 user nova-compute[74658]:       <nova:owner>
Nov 16 15:28:23 user nova-compute[74658]:         <nova:user uuid="6ed5db501b2e4dcfb742e18dfdeae88b">tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member</nova:user>
Nov 16 15:28:23 user nova-compute[74658]:         <nova:project uuid="621284eebf704320bacac96aedbc77a4">tempest-ServerBootFromVolumeStableRescueTest-1170309652</nova:project>
Nov 16 15:28:23 user nova-compute[74658]:       </nova:owner>
Nov 16 15:28:23 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:28:23 user nova-compute[74658]:       <nova:ports>
Nov 16 15:28:23 user nova-compute[74658]:         <nova:port uuid="54c165cd-1a44-4017-9b20-e2d1ebc02101">
Nov 16 15:28:23 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 15:28:23 user nova-compute[74658]:         </nova:port>
Nov 16 15:28:23 user nova-compute[74658]:       </nova:ports>
Nov 16 15:28:23 user nova-compute[74658]:     </nova:instance>
Nov 16 15:28:23 user nova-compute[74658]:   </metadata>
Nov 16 15:28:23 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:28:23 user nova-compute[74658]:     <system>
Nov 16 15:28:23 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:28:23 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:28:23 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:28:23 user nova-compute[74658]:       <entry name="serial">b6a0ca45-19d0-4644-8e65-fe904d85e1c1</entry>
Nov 16 15:28:23 user nova-compute[74658]:       <entry name="uuid">b6a0ca45-19d0-4644-8e65-fe904d85e1c1</entry>
Nov 16 15:28:23 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:28:23 user nova-compute[74658]:     </system>
Nov 16 15:28:23 user nova-compute[74658]:   </sysinfo>
Nov 16 15:28:23 user nova-compute[74658]:   <os>
Nov 16 15:28:23 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:28:23 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:28:23 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:28:23 user nova-compute[74658]:   </os>
Nov 16 15:28:23 user nova-compute[74658]:   <features>
Nov 16 15:28:23 user nova-compute[74658]:     <acpi/>
Nov 16 15:28:23 user nova-compute[74658]:     <apic/>
Nov 16 15:28:23 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:28:23 user nova-compute[74658]:   </features>
Nov 16 15:28:23 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:28:23 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:28:23 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:28:23 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:28:23 user nova-compute[74658]:   </clock>
Nov 16 15:28:23 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:28:23 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:28:23 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:28:23 user nova-compute[74658]:   </cpu>
Nov 16 15:28:23 user nova-compute[74658]:   <devices>
Nov 16 15:28:23 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:28:23 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:28:23 user nova-compute[74658]:       <source dev="/dev/sde"/>
Nov 16 15:28:23 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:28:23 user nova-compute[74658]:       <serial>5443b744-0bfd-453d-b6e9-c4a54605cb44</serial>
Nov 16 15:28:23 user nova-compute[74658]:     </disk>
Nov 16 15:28:23 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:28:23 user nova-compute[74658]:       <mac address="fa:16:3e:4d:7d:8d"/>
Nov 16 15:28:23 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:28:23 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:28:23 user nova-compute[74658]:       <target dev="tap54c165cd-1a"/>
Nov 16 15:28:23 user nova-compute[74658]:     </interface>
Nov 16 15:28:23 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:28:23 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/console.log" append="off"/>
Nov 16 15:28:23 user nova-compute[74658]:     </serial>
Nov 16 15:28:23 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:28:23 user nova-compute[74658]:     <video>
Nov 16 15:28:23 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:28:23 user nova-compute[74658]:     </video>
Nov 16 15:28:23 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:28:23 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:28:23 user nova-compute[74658]:     </rng>
Nov 16 15:28:23 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:28:23 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:28:23 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:28:23 user nova-compute[74658]:     </memballoon>
Nov 16 15:28:23 user nova-compute[74658]:   </devices>
Nov 16 15:28:23 user nova-compute[74658]: </domain>
Nov 16 15:28:23 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2014300948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2014300948',id=28,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621284eebf704320bacac96aedbc77a4',ramdisk_id='',reservation_id='r-ttx4gd15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:28:11Z,user_data=None,user_id='6ed5db501b2e4dcfb742e18dfdeae88b',uuid=b6a0ca45-19d0-4644-8e65-fe904d85e1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converting VIF {"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=54c165cd-1a44-4017-9b20-e2d1ebc02101,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c165cd-1a') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG os_vif [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=54c165cd-1a44-4017-9b20-e2d1ebc02101,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c165cd-1a') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c814d445-1735-523f-a336-e5f276042433', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54c165cd-1a, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54c165cd-1a, col_values=(('qos', UUID('8806aacc-3592-4544-ba20-b3f49849a650')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54c165cd-1a, col_values=(('external_ids', {'iface-id': '54c165cd-1a44-4017-9b20-e2d1ebc02101', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:7d:8d', 'vm-uuid': 'b6a0ca45-19d0-4644-8e65-fe904d85e1c1'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:23 user nova-compute[74658]: INFO os_vif [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=54c165cd-1a44-4017-9b20-e2d1ebc02101,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c165cd-1a')
Nov 16 15:28:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:28:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] No VIF found with MAC fa:16:3e:4d:7d:8d, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:28:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:24 user nova-compute[74658]: DEBUG nova.compute.manager [req-f6744f91-2200-4130-9ba6-551b59d03cc3 req-531cfdd9-0f25-4ebf-9a11-fae32b9b6e8b service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f6744f91-2200-4130-9ba6-551b59d03cc3 req-531cfdd9-0f25-4ebf-9a11-fae32b9b6e8b service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f6744f91-2200-4130-9ba6-551b59d03cc3 req-531cfdd9-0f25-4ebf-9a11-fae32b9b6e8b service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f6744f91-2200-4130-9ba6-551b59d03cc3 req-531cfdd9-0f25-4ebf-9a11-fae32b9b6e8b service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:24 user nova-compute[74658]: DEBUG nova.compute.manager [req-f6744f91-2200-4130-9ba6-551b59d03cc3 req-531cfdd9-0f25-4ebf-9a11-fae32b9b6e8b service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:28:24 user nova-compute[74658]: WARNING nova.compute.manager [req-f6744f91-2200-4130-9ba6-551b59d03cc3 req-531cfdd9-0f25-4ebf-9a11-fae32b9b6e8b service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received unexpected event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with vm_state building and task_state spawning.
Nov 16 15:28:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:28:26 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Instance spawned successfully.
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:26 user nova-compute[74658]: INFO nova.compute.manager [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:28:26 user nova-compute[74658]: INFO nova.compute.manager [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Took 16.91 seconds to build instance.
Nov 16 15:28:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0ffbb3d-5df2-4b8d-84b0-c45e7388d935 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-83b5a80d-87df-4cbd-800d-811a6f1cdd51 req-dc7d2b54-f2dd-4ef2-aff4-558e3c493bd8 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83b5a80d-87df-4cbd-800d-811a6f1cdd51 req-dc7d2b54-f2dd-4ef2-aff4-558e3c493bd8 service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83b5a80d-87df-4cbd-800d-811a6f1cdd51 req-dc7d2b54-f2dd-4ef2-aff4-558e3c493bd8 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83b5a80d-87df-4cbd-800d-811a6f1cdd51 req-dc7d2b54-f2dd-4ef2-aff4-558e3c493bd8 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-83b5a80d-87df-4cbd-800d-811a6f1cdd51 req-dc7d2b54-f2dd-4ef2-aff4-558e3c493bd8 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:28:26 user nova-compute[74658]: WARNING nova.compute.manager [req-83b5a80d-87df-4cbd-800d-811a6f1cdd51 req-dc7d2b54-f2dd-4ef2-aff4-558e3c493bd8 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received unexpected event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with vm_state active and task_state None.
Nov 16 15:28:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "67d2aeee-7218-4e85-baa3-157643a4301e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:28:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:28:29 user nova-compute[74658]: INFO nova.compute.claims [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Claim successful on node user
Nov 16 15:28:29 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:28:29 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:28:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:28:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:28:29 user nova-compute[74658]: DEBUG nova.network.neutron [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:28:29 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:28:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG nova.policy [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8507e72d5b248cd8a6a8b9bea6733cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b189fdeea224d4dbdc2923041dc8e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:28:30 user nova-compute[74658]: INFO nova.virt.block_device [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Booting with volume ce1d3c13-65f3-4338-91c5-5ee6dbc0392a at /dev/vda
Nov 16 15:28:30 user nova-compute[74658]: DEBUG os_brick.utils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f06e42c-0803-415e-9288-2547d729ac03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d53404-0640-4ac9-9e4d-380bd7731f2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3810ded6-2a4d-4695-b478-af02c603d14e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[95449af7-5557-405c-92d8-bdd4c4011634]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:28:30 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:28:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7aec3e-3bac-4c9a-8f9f-41095e4cd953]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG os_brick.utils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating existing volume attachment record: ea605355-dd53-40b4-bebc-766d11d14e0f {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:30 user nova-compute[74658]: DEBUG nova.network.neutron [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Successfully created port: d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:28:31 user nova-compute[74658]: DEBUG nova.network.neutron [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Successfully updated port: d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:28:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:28:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquired lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:28:31 user nova-compute[74658]: DEBUG nova.network.neutron [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:28:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-3975169d-cdfb-4ad5-a0f1-4d99d9d8511c req-d0b0d2ac-a562-4137-b86c-0b415c2e8a17 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-changed-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-3975169d-cdfb-4ad5-a0f1-4d99d9d8511c req-d0b0d2ac-a562-4137-b86c-0b415c2e8a17 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Refreshing instance network info cache due to event network-changed-d530bb58-eab8-4783-b16b-b1ec126da39f. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:28:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3975169d-cdfb-4ad5-a0f1-4d99d9d8511c req-d0b0d2ac-a562-4137-b86c-0b415c2e8a17 service nova] Acquiring lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:28:31 user nova-compute[74658]: DEBUG nova.network.neutron [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:28:32 user nova-compute[74658]: DEBUG nova.network.neutron [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating instance_info_cache with network_info: [{"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:28:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Releasing lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:28:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Instance network_info: |[{"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:28:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3975169d-cdfb-4ad5-a0f1-4d99d9d8511c req-d0b0d2ac-a562-4137-b86c-0b415c2e8a17 service nova] Acquired lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:28:32 user nova-compute[74658]: DEBUG nova.network.neutron [req-3975169d-cdfb-4ad5-a0f1-4d99d9d8511c req-d0b0d2ac-a562-4137-b86c-0b415c2e8a17 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Refreshing network info cache for port d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:28:32 user nova-compute[74658]: DEBUG nova.network.neutron [req-3975169d-cdfb-4ad5-a0f1-4d99d9d8511c req-d0b0d2ac-a562-4137-b86c-0b415c2e8a17 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updated VIF entry in instance network info cache for port d530bb58-eab8-4783-b16b-b1ec126da39f. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:28:32 user nova-compute[74658]: DEBUG nova.network.neutron [req-3975169d-cdfb-4ad5-a0f1-4d99d9d8511c req-d0b0d2ac-a562-4137-b86c-0b415c2e8a17 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating instance_info_cache with network_info: [{"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:28:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3975169d-cdfb-4ad5-a0f1-4d99d9d8511c req-d0b0d2ac-a562-4137-b86c-0b415c2e8a17 service nova] Releasing lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:28:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:28:35 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Creating image(s)
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Ensure instance console log exists: /opt/stack/data/nova/instances/67d2aeee-7218-4e85-baa3-157643a4301e/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Start _get_guest_xml network_info=[{"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ea605355-dd53-40b4-bebc-766d11d14e0f', 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucsVCmpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67d2aeee-7218-4e85-baa3-157643a4301e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 'serial': 'ce1d3c13-65f3-4338-91c5-5ee6dbc0392a'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:28:35 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:28:35 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucsVCmpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:28:35 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:28:35 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:28:35 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4464c17a-375b-4bb9-a810-58942db9a376]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:28:35 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db5b135-87c3-413d-8f1c-198f136f0356]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a] added
Nov 16 15:28:35 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1165462-528b-492d-8eaa-e077ee7f5573]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[42784518-369e-4162-9bd7-5e2afa1f9244]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucsVCmpR {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucsVCmpR" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb98f82-1593-42f8-9958-9afbc1e527d1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ucsVCmpR'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d465e6-22e4-4159-97eb-37abbb0c0f81]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcafa41-6aca-4182-991d-ba00e602665e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:35 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:35 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:35 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:35 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:35 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:35 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:35 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:35 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:28:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5105289a-0f72-4bd2-90f4-26c632224a9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260]
Nov 16 15:28:36 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260] successful.
Nov 16 15:28:36 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[262c9818-1235-408e-8d22-350d522201d4]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ce0179-747f-47f8-a567-ea3b017d433e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:36 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:36 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:36 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:36 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:28:36 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:36 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:36 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:36 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:36 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:28:36 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ce07d8-41db-4e6c-84b9-1b3565d4562c]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:36 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucsVCmpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23965373366323733', 'path': '/dev/sdf'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965373366323733', 'path': '/dev/sdf'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-966150362',display_name='tempest-ServerActionsTestOtherA-server-966150362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-966150362',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfs3x9tKyy9KHJUedCxh49P9LH14YRsacTcDaxEVd8YqO4Cuyb8pJja3XT1OhFAuM946OKuatB2JwDtDIzcfi6ebK97F+SRlzAxuSg9qPWnSDGTyfFCtkcgNG6s/nMQMw==',key_name='tempest-keypair-1686675082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-bmp0xx53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=67d2aeee-7218-4e85-baa3-157643a4301e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG nova.objects.instance [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'pci_devices' on Instance uuid 67d2aeee-7218-4e85-baa3-157643a4301e {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:28:37 user nova-compute[74658]:   <uuid>67d2aeee-7218-4e85-baa3-157643a4301e</uuid>
Nov 16 15:28:37 user nova-compute[74658]:   <name>instance-0000001d</name>
Nov 16 15:28:37 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:28:37 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:28:37 user nova-compute[74658]:   <metadata>
Nov 16 15:28:37 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:28:37 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:28:37 user nova-compute[74658]:       <nova:name>tempest-ServerActionsTestOtherA-server-966150362</nova:name>
Nov 16 15:28:37 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:28:35</nova:creationTime>
Nov 16 15:28:37 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:28:37 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:28:37 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:28:37 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:28:37 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:28:37 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:28:37 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:28:37 user nova-compute[74658]:       <nova:owner>
Nov 16 15:28:37 user nova-compute[74658]:         <nova:user uuid="d8507e72d5b248cd8a6a8b9bea6733cb">tempest-ServerActionsTestOtherA-1362925052-project-member</nova:user>
Nov 16 15:28:37 user nova-compute[74658]:         <nova:project uuid="6b189fdeea224d4dbdc2923041dc8e75">tempest-ServerActionsTestOtherA-1362925052</nova:project>
Nov 16 15:28:37 user nova-compute[74658]:       </nova:owner>
Nov 16 15:28:37 user nova-compute[74658]:       <nova:ports>
Nov 16 15:28:37 user nova-compute[74658]:         <nova:port uuid="d530bb58-eab8-4783-b16b-b1ec126da39f">
Nov 16 15:28:37 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 15:28:37 user nova-compute[74658]:         </nova:port>
Nov 16 15:28:37 user nova-compute[74658]:       </nova:ports>
Nov 16 15:28:37 user nova-compute[74658]:     </nova:instance>
Nov 16 15:28:37 user nova-compute[74658]:   </metadata>
Nov 16 15:28:37 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:28:37 user nova-compute[74658]:     <system>
Nov 16 15:28:37 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:28:37 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:28:37 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:28:37 user nova-compute[74658]:       <entry name="serial">67d2aeee-7218-4e85-baa3-157643a4301e</entry>
Nov 16 15:28:37 user nova-compute[74658]:       <entry name="uuid">67d2aeee-7218-4e85-baa3-157643a4301e</entry>
Nov 16 15:28:37 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:28:37 user nova-compute[74658]:     </system>
Nov 16 15:28:37 user nova-compute[74658]:   </sysinfo>
Nov 16 15:28:37 user nova-compute[74658]:   <os>
Nov 16 15:28:37 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:28:37 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:28:37 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:28:37 user nova-compute[74658]:   </os>
Nov 16 15:28:37 user nova-compute[74658]:   <features>
Nov 16 15:28:37 user nova-compute[74658]:     <acpi/>
Nov 16 15:28:37 user nova-compute[74658]:     <apic/>
Nov 16 15:28:37 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:28:37 user nova-compute[74658]:   </features>
Nov 16 15:28:37 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:28:37 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:28:37 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:28:37 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:28:37 user nova-compute[74658]:   </clock>
Nov 16 15:28:37 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:28:37 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:28:37 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:28:37 user nova-compute[74658]:   </cpu>
Nov 16 15:28:37 user nova-compute[74658]:   <devices>
Nov 16 15:28:37 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:28:37 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:28:37 user nova-compute[74658]:       <source dev="/dev/sdf"/>
Nov 16 15:28:37 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:28:37 user nova-compute[74658]:       <serial>ce1d3c13-65f3-4338-91c5-5ee6dbc0392a</serial>
Nov 16 15:28:37 user nova-compute[74658]:     </disk>
Nov 16 15:28:37 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:28:37 user nova-compute[74658]:       <mac address="fa:16:3e:26:89:6f"/>
Nov 16 15:28:37 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:28:37 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:28:37 user nova-compute[74658]:       <target dev="tapd530bb58-ea"/>
Nov 16 15:28:37 user nova-compute[74658]:     </interface>
Nov 16 15:28:37 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:28:37 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/67d2aeee-7218-4e85-baa3-157643a4301e/console.log" append="off"/>
Nov 16 15:28:37 user nova-compute[74658]:     </serial>
Nov 16 15:28:37 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:28:37 user nova-compute[74658]:     <video>
Nov 16 15:28:37 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:28:37 user nova-compute[74658]:     </video>
Nov 16 15:28:37 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:28:37 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:28:37 user nova-compute[74658]:     </rng>
Nov 16 15:28:37 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:28:37 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:28:37 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:28:37 user nova-compute[74658]:     </memballoon>
Nov 16 15:28:37 user nova-compute[74658]:   </devices>
Nov 16 15:28:37 user nova-compute[74658]: </domain>
Nov 16 15:28:37 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-966150362',display_name='tempest-ServerActionsTestOtherA-server-966150362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-966150362',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfs3x9tKyy9KHJUedCxh49P9LH14YRsacTcDaxEVd8YqO4Cuyb8pJja3XT1OhFAuM946OKuatB2JwDtDIzcfi6ebK97F+SRlzAxuSg9qPWnSDGTyfFCtkcgNG6s/nMQMw==',key_name='tempest-keypair-1686675082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-bmp0xx53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=67d2aeee-7218-4e85-baa3-157643a4301e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG os_vif [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71621cfc-3451-5aaf-830c-86427ce76a34', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd530bb58-ea, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd530bb58-ea, col_values=(('qos', UUID('532c6846-2e2e-4f7b-b7a9-94e677d10878')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd530bb58-ea, col_values=(('external_ids', {'iface-id': 'd530bb58-eab8-4783-b16b-b1ec126da39f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:89:6f', 'vm-uuid': '67d2aeee-7218-4e85-baa3-157643a4301e'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:37 user nova-compute[74658]: INFO os_vif [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea')
Nov 16 15:28:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:28:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No VIF found with MAC fa:16:3e:26:89:6f, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:28:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:38 user nova-compute[74658]: DEBUG nova.compute.manager [req-5f6a3524-df9e-44a5-bb17-2d30a0570bdb req-23590658-9990-4491-93b8-daa94ace6758 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5f6a3524-df9e-44a5-bb17-2d30a0570bdb req-23590658-9990-4491-93b8-daa94ace6758 service nova] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5f6a3524-df9e-44a5-bb17-2d30a0570bdb req-23590658-9990-4491-93b8-daa94ace6758 service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5f6a3524-df9e-44a5-bb17-2d30a0570bdb req-23590658-9990-4491-93b8-daa94ace6758 service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:38 user nova-compute[74658]: DEBUG nova.compute.manager [req-5f6a3524-df9e-44a5-bb17-2d30a0570bdb req-23590658-9990-4491-93b8-daa94ace6758 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] No waiting events found dispatching network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:28:38 user nova-compute[74658]: WARNING nova.compute.manager [req-5f6a3524-df9e-44a5-bb17-2d30a0570bdb req-23590658-9990-4491-93b8-daa94ace6758 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received unexpected event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f for instance with vm_state building and task_state spawning.
Nov 16 15:28:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.compute.manager [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:28:40 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Instance spawned successfully.
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:28:40 user nova-compute[74658]: INFO nova.compute.manager [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.compute.manager [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.compute.manager [req-a61e30b7-8961-4c4d-b570-47830879c9f2 req-d44790d2-2a92-492e-9223-1a9ec2b81e1d service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a61e30b7-8961-4c4d-b570-47830879c9f2 req-d44790d2-2a92-492e-9223-1a9ec2b81e1d service nova] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a61e30b7-8961-4c4d-b570-47830879c9f2 req-d44790d2-2a92-492e-9223-1a9ec2b81e1d service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a61e30b7-8961-4c4d-b570-47830879c9f2 req-d44790d2-2a92-492e-9223-1a9ec2b81e1d service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:40 user nova-compute[74658]: DEBUG nova.compute.manager [req-a61e30b7-8961-4c4d-b570-47830879c9f2 req-d44790d2-2a92-492e-9223-1a9ec2b81e1d service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] No waiting events found dispatching network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:28:40 user nova-compute[74658]: WARNING nova.compute.manager [req-a61e30b7-8961-4c4d-b570-47830879c9f2 req-d44790d2-2a92-492e-9223-1a9ec2b81e1d service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received unexpected event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f for instance with vm_state building and task_state spawning.
Nov 16 15:28:40 user nova-compute[74658]: INFO nova.compute.manager [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Took 11.35 seconds to build instance.
Nov 16 15:28:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-667ee3fd-f1a6-43d9-8133-f2e64d03f055 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "67d2aeee-7218-4e85-baa3-157643a4301e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.525s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-209ae07c-e34b-4ec8-bdeb-e3adf749c058 req-4bb73c02-f136-41dd-9492-48b92b1fdd66 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-changed-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-209ae07c-e34b-4ec8-bdeb-e3adf749c058 req-4bb73c02-f136-41dd-9492-48b92b1fdd66 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Refreshing instance network info cache due to event network-changed-1aaa65c9-53cf-439c-89b1-90afbc230119. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:28:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-209ae07c-e34b-4ec8-bdeb-e3adf749c058 req-4bb73c02-f136-41dd-9492-48b92b1fdd66 service nova] Acquiring lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:28:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-209ae07c-e34b-4ec8-bdeb-e3adf749c058 req-4bb73c02-f136-41dd-9492-48b92b1fdd66 service nova] Acquired lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:28:43 user nova-compute[74658]: DEBUG nova.network.neutron [req-209ae07c-e34b-4ec8-bdeb-e3adf749c058 req-4bb73c02-f136-41dd-9492-48b92b1fdd66 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Refreshing network info cache for port 1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:28:44 user nova-compute[74658]: DEBUG nova.network.neutron [req-209ae07c-e34b-4ec8-bdeb-e3adf749c058 req-4bb73c02-f136-41dd-9492-48b92b1fdd66 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updated VIF entry in instance network info cache for port 1aaa65c9-53cf-439c-89b1-90afbc230119. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:28:44 user nova-compute[74658]: DEBUG nova.network.neutron [req-209ae07c-e34b-4ec8-bdeb-e3adf749c058 req-4bb73c02-f136-41dd-9492-48b92b1fdd66 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updating instance_info_cache with network_info: [{"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:28:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-209ae07c-e34b-4ec8-bdeb-e3adf749c058 req-4bb73c02-f136-41dd-9492-48b92b1fdd66 service nova] Releasing lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:28:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:47 user nova-compute[74658]: INFO nova.compute.manager [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Shelving
Nov 16 15:28:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-116c7636-98e9-4ce5-ab7f-6a3cbf48c540 req-753c21cc-d519-4ba6-8671-ac7367266bcc service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-vif-unplugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-116c7636-98e9-4ce5-ab7f-6a3cbf48c540 req-753c21cc-d519-4ba6-8671-ac7367266bcc service nova] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-116c7636-98e9-4ce5-ab7f-6a3cbf48c540 req-753c21cc-d519-4ba6-8671-ac7367266bcc service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-116c7636-98e9-4ce5-ab7f-6a3cbf48c540 req-753c21cc-d519-4ba6-8671-ac7367266bcc service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-116c7636-98e9-4ce5-ab7f-6a3cbf48c540 req-753c21cc-d519-4ba6-8671-ac7367266bcc service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] No waiting events found dispatching network-vif-unplugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:28:48 user nova-compute[74658]: WARNING nova.compute.manager [req-116c7636-98e9-4ce5-ab7f-6a3cbf48c540 req-753c21cc-d519-4ba6-8671-ac7367266bcc service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received unexpected event network-vif-unplugged-1aaa65c9-53cf-439c-89b1-90afbc230119 for instance with vm_state active and task_state shelving.
Nov 16 15:28:48 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Instance destroyed successfully.
Nov 16 15:28:48 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Beginning cold snapshot process
Nov 16 15:28:48 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:28:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk /opt/stack/data/nova/instances/snapshots/tmp_45pm4s_/b1a4d06bfeb9485aa183fc69e99ca307 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk /opt/stack/data/nova/instances/snapshots/tmp_45pm4s_/b1a4d06bfeb9485aa183fc69e99ca307" returned: 0 in 1.238s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:49 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Snapshot extracted, beginning image upload
Nov 16 15:28:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-cee1a052-7010-4188-ad3d-99068e1f4d8e req-d25763e7-5ccc-4855-aa1a-236dae0cd910 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cee1a052-7010-4188-ad3d-99068e1f4d8e req-d25763e7-5ccc-4855-aa1a-236dae0cd910 service nova] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cee1a052-7010-4188-ad3d-99068e1f4d8e req-d25763e7-5ccc-4855-aa1a-236dae0cd910 service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cee1a052-7010-4188-ad3d-99068e1f4d8e req-d25763e7-5ccc-4855-aa1a-236dae0cd910 service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-cee1a052-7010-4188-ad3d-99068e1f4d8e req-d25763e7-5ccc-4855-aa1a-236dae0cd910 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] No waiting events found dispatching network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:28:50 user nova-compute[74658]: WARNING nova.compute.manager [req-cee1a052-7010-4188-ad3d-99068e1f4d8e req-d25763e7-5ccc-4855-aa1a-236dae0cd910 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received unexpected event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 15:28:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Snapshot image upload complete
Nov 16 15:28:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:28:52 user nova-compute[74658]: INFO nova.compute.manager [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Shelve offloading
Nov 16 15:28:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Instance destroyed successfully.
Nov 16 15:28:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:28:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:28:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquired lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:28:52 user nova-compute[74658]: DEBUG nova.network.neutron [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:28:52 user nova-compute[74658]: DEBUG nova.network.neutron [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updating instance_info_cache with network_info: [{"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Releasing lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:28:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Instance destroyed successfully.
Nov 16 15:28:53 user nova-compute[74658]: DEBUG nova.objects.instance [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'resources' on Instance uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-909763891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-909763891',id=26,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6B2As6euHF6EOU2uQ2X/k5aA2RDKadyeTUrxMV8YTOQg0RBAAjU0lxyCB4onxqpvWrFnYJxo2/4tL7xWFO5wkc//rQaHy6VMnvx+fev8tC2XpCVog5oIo0Mep1avUsKA==',key_name='tempest-keypair-876002203',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:26:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-m5jl5mv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member',shelved_at='2023-11-16T15:28:52.457807',shelved_host='user',shelved_image_id='e94e4679-797f-4bcb-9a0d-3b58bb3c0f25'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:28:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=f314ad85-524a-4326-bdd5-2c7c4de78690,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG os_vif [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aaa65c9-53, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-2a2dcc21-d9e8-43e5-bcd6-1573f0c770c2 req-2aa0082b-7012-4e78-a627-5b09bace1e0a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-changed-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-2a2dcc21-d9e8-43e5-bcd6-1573f0c770c2 req-2aa0082b-7012-4e78-a627-5b09bace1e0a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Refreshing instance network info cache due to event network-changed-1aaa65c9-53cf-439c-89b1-90afbc230119. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a2dcc21-d9e8-43e5-bcd6-1573f0c770c2 req-2aa0082b-7012-4e78-a627-5b09bace1e0a service nova] Acquiring lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a2dcc21-d9e8-43e5-bcd6-1573f0c770c2 req-2aa0082b-7012-4e78-a627-5b09bace1e0a service nova] Acquired lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG nova.network.neutron [req-2a2dcc21-d9e8-43e5-bcd6-1573f0c770c2 req-2aa0082b-7012-4e78-a627-5b09bace1e0a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Refreshing network info cache for port 1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da9c801c-6477-47bd-96fb-065d7ce3a02a) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:53 user nova-compute[74658]: INFO os_vif [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53')
Nov 16 15:28:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Deleting instance files /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690_del
Nov 16 15:28:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Deletion of /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690_del complete
Nov 16 15:28:53 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Deleted allocations for instance f314ad85-524a-4326-bdd5-2c7c4de78690
Nov 16 15:28:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG nova.objects.instance [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'numa_topology' on Instance uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:53 user nova-compute[74658]: DEBUG nova.objects.base [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Object Instance<f314ad85-524a-4326-bdd5-2c7c4de78690> lazy-loaded attributes: resources,numa_topology {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:28:54 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:28:54 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:28:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cc4d0203-1c99-439b-9359-114f71efe7a6 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.384s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:28:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-2a2dcc21-d9e8-43e5-bcd6-1573f0c770c2 req-2aa0082b-7012-4e78-a627-5b09bace1e0a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updated VIF entry in instance network info cache for port 1aaa65c9-53cf-439c-89b1-90afbc230119. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:28:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-2a2dcc21-d9e8-43e5-bcd6-1573f0c770c2 req-2aa0082b-7012-4e78-a627-5b09bace1e0a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updating instance_info_cache with network_info: [{"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:28:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a2dcc21-d9e8-43e5-bcd6-1573f0c770c2 req-2aa0082b-7012-4e78-a627-5b09bace1e0a service nova] Releasing lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:28:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:56 user nova-compute[74658]: DEBUG nova.objects.instance [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:28:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquired lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:28:56 user nova-compute[74658]: DEBUG nova.network.neutron [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:28:56 user nova-compute[74658]: DEBUG nova.objects.instance [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'info_cache' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:56 user nova-compute[74658]: DEBUG nova.objects.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.network.neutron [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updating instance_info_cache with network_info: [{"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Releasing lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:28:57 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance destroyed successfully.
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.objects.instance [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'resources' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.objects.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-855420044',display_name='tempest-AttachVolumeTestJSON-server-855420044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-855420044',id=21,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0aQzQPL9O0sCZYH1ntlAkbDeS1BfXalYyPNg5mzbOT3rQ3DQzwLD0COpv3rF6yI3D5ElP0hp1r6opeP6BA0IQrQD2St0Ieh9euvcCJptTl1EjscoAuo3T+KfsTBHg0uQ==',key_name='tempest-keypair-2113042845',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-rfy50ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:27:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=6c8dd806-c294-40dd-a13d-63659a1d5669,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_vif [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadd946f4-de, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb219db9-9653-4a7d-9ace-66a59fad3440) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:57 user nova-compute[74658]: INFO os_vif [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de')
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLMgEmIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:28:57 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee174c8-28a0-4a2e-bd6e-1ddad89f48ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:28:57 user nova-compute[74658]: No targets found.
Nov 16 15:28:57 user nova-compute[74658]: iSNS:
Nov 16 15:28:57 user nova-compute[74658]: No targets found.
Nov 16 15:28:57 user nova-compute[74658]: STATIC:
Nov 16 15:28:57 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11
Nov 16 15:28:57 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:28:57 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:28:57 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de
Nov 16 15:28:57 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:28:57 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:28:57 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a
Nov 16 15:28:57 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:28:57 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:28:57 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44
Nov 16 15:28:57 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:28:57 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:28:57 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7
Nov 16 15:28:57 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:28:57 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:28:57 user nova-compute[74658]: FIRMWARE:
Nov 16 15:28:57 user nova-compute[74658]: No targets found.
Nov 16 15:28:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:28:57 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:28:57 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[823dc13b-6481-4aff-895e-560163dfe886]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[12467fa6-bcd6-43f9-83e2-a4edcac48101]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:28:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:28:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710370ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[becca4e6-6824-4374-816a-15838ae2e17a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd57eee-2e5a-4e53-9f2e-274ca2e690c4]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8141eb7-b225-4709-97e1-a534729c13ba]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fcdbcb-f603-49e6-b0f5-a2cec0dd6d02]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd36e8e-7b27-493f-a521-811ce241fa1a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eda33e-9251-4959-a229-c0bf8eb7a1be]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260]
Nov 16 15:28:57 user nova-compute[74658]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260] successful.
Nov 16 15:28:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[385f8e82-a653-45f6-a837-26dbc07a35e7]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] <== disconnect_volume: return (311ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Start _get_guest_xml network_info=[{"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '861720e8-c725-4bd9-931c-a4327e33307f', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLMgEmIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6c8dd806-c294-40dd-a13d-63659a1d5669', 'attached_at': '', 'detached_at': '', 'volume_id': '7e403a0a-3fdc-495b-a0fb-5f05422f3ea7', 'serial': '7e403a0a-3fdc-495b-a0fb-5f05422f3ea7'}, 'boot_index': None, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.objects.instance [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.objects.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:28:57 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:28:57 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.objects.instance [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.objects.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLMgEmIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:28:57 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:28:57 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:28:57 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b482f6b8-65d8-4f01-a97e-02279cc840ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:28:57 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7de64b6-27e2-4ea9-8d8c-0d74aeba2278]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7] added
Nov 16 15:28:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2608273-1c95-4a6b-a6c1-79c89b551ac0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[306320ef-ef44-4005-b744-a15a8c97bc01]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLMgEmIX {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLMgEmIX" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efdb55e-0106-4992-b8a2-dffffff797ea]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DLMgEmIX'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cac9760-d201-4d3d-b45c-fe1956591c1a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b36f410-f0a7-46d6-9e7f-d738eca183d5]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:28:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:57 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:28:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fd613f-f831-479b-b090-217cf9b278d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260]
Nov 16 15:28:57 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260] successful.
Nov 16 15:28:57 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:57 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c956ca95-42d3-43d0-a38b-3091fb177dd8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b347d8b1-ca38-4fa1-b7da-e99800f1d23f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:58 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:58 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:58 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:28:58 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:28:58 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:28:58 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:28:58 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:28:58 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:28:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bffd65f-58f3-460e-9a5a-026fc65950fd]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:28:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLMgEmIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23434353861643835', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434353861643835', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-855420044',display_name='tempest-AttachVolumeTestJSON-server-855420044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-855420044',id=21,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0aQzQPL9O0sCZYH1ntlAkbDeS1BfXalYyPNg5mzbOT3rQ3DQzwLD0COpv3rF6yI3D5ElP0hp1r6opeP6BA0IQrQD2St0Ieh9euvcCJptTl1EjscoAuo3T+KfsTBHg0uQ==',key_name='tempest-keypair-2113042845',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-rfy50ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:27:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=6c8dd806-c294-40dd-a13d-63659a1d5669,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.objects.instance [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.objects.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:28:59 user nova-compute[74658]:   <uuid>6c8dd806-c294-40dd-a13d-63659a1d5669</uuid>
Nov 16 15:28:59 user nova-compute[74658]:   <name>instance-00000015</name>
Nov 16 15:28:59 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:28:59 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:28:59 user nova-compute[74658]:   <metadata>
Nov 16 15:28:59 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:28:59 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:28:59 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeTestJSON-server-855420044</nova:name>
Nov 16 15:28:59 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:28:57</nova:creationTime>
Nov 16 15:28:59 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:28:59 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:28:59 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:28:59 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:28:59 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:28:59 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:28:59 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:28:59 user nova-compute[74658]:       <nova:owner>
Nov 16 15:28:59 user nova-compute[74658]:         <nova:user uuid="f04b6f7159cc4358a2978e9c97aa2dfc">tempest-AttachVolumeTestJSON-1830126630-project-member</nova:user>
Nov 16 15:28:59 user nova-compute[74658]:         <nova:project uuid="634ad79271c9408da094067dd3c209d7">tempest-AttachVolumeTestJSON-1830126630</nova:project>
Nov 16 15:28:59 user nova-compute[74658]:       </nova:owner>
Nov 16 15:28:59 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:28:59 user nova-compute[74658]:       <nova:ports>
Nov 16 15:28:59 user nova-compute[74658]:         <nova:port uuid="add946f4-de44-48b9-9de4-3c76c1d1c8ae">
Nov 16 15:28:59 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 15:28:59 user nova-compute[74658]:         </nova:port>
Nov 16 15:28:59 user nova-compute[74658]:       </nova:ports>
Nov 16 15:28:59 user nova-compute[74658]:     </nova:instance>
Nov 16 15:28:59 user nova-compute[74658]:   </metadata>
Nov 16 15:28:59 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:28:59 user nova-compute[74658]:     <system>
Nov 16 15:28:59 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:28:59 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:28:59 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:28:59 user nova-compute[74658]:       <entry name="serial">6c8dd806-c294-40dd-a13d-63659a1d5669</entry>
Nov 16 15:28:59 user nova-compute[74658]:       <entry name="uuid">6c8dd806-c294-40dd-a13d-63659a1d5669</entry>
Nov 16 15:28:59 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:28:59 user nova-compute[74658]:     </system>
Nov 16 15:28:59 user nova-compute[74658]:   </sysinfo>
Nov 16 15:28:59 user nova-compute[74658]:   <os>
Nov 16 15:28:59 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:28:59 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:28:59 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:28:59 user nova-compute[74658]:   </os>
Nov 16 15:28:59 user nova-compute[74658]:   <features>
Nov 16 15:28:59 user nova-compute[74658]:     <acpi/>
Nov 16 15:28:59 user nova-compute[74658]:     <apic/>
Nov 16 15:28:59 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:28:59 user nova-compute[74658]:   </features>
Nov 16 15:28:59 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:28:59 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:28:59 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:28:59 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:28:59 user nova-compute[74658]:   </clock>
Nov 16 15:28:59 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:28:59 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:28:59 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:28:59 user nova-compute[74658]:   </cpu>
Nov 16 15:28:59 user nova-compute[74658]:   <devices>
Nov 16 15:28:59 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:28:59 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:28:59 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk"/>
Nov 16 15:28:59 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:28:59 user nova-compute[74658]:     </disk>
Nov 16 15:28:59 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:28:59 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:28:59 user nova-compute[74658]:       <source dev="/dev/sdb"/>
Nov 16 15:28:59 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:28:59 user nova-compute[74658]:       <serial>7e403a0a-3fdc-495b-a0fb-5f05422f3ea7</serial>
Nov 16 15:28:59 user nova-compute[74658]:     </disk>
Nov 16 15:28:59 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:28:59 user nova-compute[74658]:       <mac address="fa:16:3e:f1:80:2c"/>
Nov 16 15:28:59 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:28:59 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:28:59 user nova-compute[74658]:       <target dev="tapadd946f4-de"/>
Nov 16 15:28:59 user nova-compute[74658]:     </interface>
Nov 16 15:28:59 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:28:59 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/console.log" append="off"/>
Nov 16 15:28:59 user nova-compute[74658]:     </serial>
Nov 16 15:28:59 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:28:59 user nova-compute[74658]:     <video>
Nov 16 15:28:59 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:28:59 user nova-compute[74658]:     </video>
Nov 16 15:28:59 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:28:59 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:28:59 user nova-compute[74658]:     </rng>
Nov 16 15:28:59 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:28:59 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:28:59 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:28:59 user nova-compute[74658]:     </memballoon>
Nov 16 15:28:59 user nova-compute[74658]:   </devices>
Nov 16 15:28:59 user nova-compute[74658]: </domain>
Nov 16 15:28:59 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.objects.instance [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.objects.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Cannot resize image /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.objects.instance [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'migration_context' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.objects.base [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-855420044',display_name='tempest-AttachVolumeTestJSON-server-855420044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-855420044',id=21,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0aQzQPL9O0sCZYH1ntlAkbDeS1BfXalYyPNg5mzbOT3rQ3DQzwLD0COpv3rF6yI3D5ElP0hp1r6opeP6BA0IQrQD2St0Ieh9euvcCJptTl1EjscoAuo3T+KfsTBHg0uQ==',key_name='tempest-keypair-2113042845',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-rfy50ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:27:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=6c8dd806-c294-40dd-a13d-63659a1d5669,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG os_vif [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1187be47-9485-5392-b79b-0f1793077c8d', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadd946f4-de, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadd946f4-de, col_values=(('qos', UUID('4d70baee-9270-45b8-bad1-187cf2dbf112')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadd946f4-de, col_values=(('external_ids', {'iface-id': 'add946f4-de44-48b9-9de4-3c76c1d1c8ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:80:2c', 'vm-uuid': '6c8dd806-c294-40dd-a13d-63659a1d5669'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:28:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:28:59 user nova-compute[74658]: INFO os_vif [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de')
Nov 16 15:29:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-df979033-8ac7-414b-873b-1f9732f1e43b req-fb41f408-357b-4633-be65-e3ebc149dc03 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:29:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-df979033-8ac7-414b-873b-1f9732f1e43b req-fb41f408-357b-4633-be65-e3ebc149dc03 service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-df979033-8ac7-414b-873b-1f9732f1e43b req-fb41f408-357b-4633-be65-e3ebc149dc03 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-df979033-8ac7-414b-873b-1f9732f1e43b req-fb41f408-357b-4633-be65-e3ebc149dc03 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-df979033-8ac7-414b-873b-1f9732f1e43b req-fb41f408-357b-4633-be65-e3ebc149dc03 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:29:01 user nova-compute[74658]: WARNING nova.compute.manager [req-df979033-8ac7-414b-873b-1f9732f1e43b req-fb41f408-357b-4633-be65-e3ebc149dc03 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received unexpected event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with vm_state stopped and task_state powering-on.
Nov 16 15:29:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 7ef751d1-099a-4b46-b08d-99929d449ef9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updating instance_info_cache with network_info: [{"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:29:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:29:03 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance rebooted successfully.
Nov 16 15:29:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e342c6bf-aad1-48af-a3c9-214241655af1 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-6433e6f3-f1ff-4d3d-b6b1-ba3b2acf1cc3 req-0e5e603f-0a86-48f9-a5f3-a6917af2809c service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6433e6f3-f1ff-4d3d-b6b1-ba3b2acf1cc3 req-0e5e603f-0a86-48f9-a5f3-a6917af2809c service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6433e6f3-f1ff-4d3d-b6b1-ba3b2acf1cc3 req-0e5e603f-0a86-48f9-a5f3-a6917af2809c service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6433e6f3-f1ff-4d3d-b6b1-ba3b2acf1cc3 req-0e5e603f-0a86-48f9-a5f3-a6917af2809c service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-6433e6f3-f1ff-4d3d-b6b1-ba3b2acf1cc3 req-0e5e603f-0a86-48f9-a5f3-a6917af2809c service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:29:03 user nova-compute[74658]: WARNING nova.compute.manager [req-6433e6f3-f1ff-4d3d-b6b1-ba3b2acf1cc3 req-0e5e603f-0a86-48f9-a5f3-a6917af2809c service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received unexpected event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with vm_state active and task_state None.
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:29:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:29:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:29:05 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:29:05 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7895MB free_disk=25.34044647216797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6c8dd806-c294-40dd-a13d-63659a1d5669 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 97135af5-e020-482b-a54b-6cf30a5443d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 5834c073-5392-40f8-bd69-8e7b50cd42ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance b6a0ca45-19d0-4644-8e65-fe904d85e1c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 67d2aeee-7218-4e85-baa3-157643a4301e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:29:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:07 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:29:07 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:29:07 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:29:07 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:29:07 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:29:07 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:29:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:29:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:29:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-640e4f52-98ac-4e74-bf75-b116ec9bc35e req-19af109d-e7ba-41b0-9747-a40be724b5c0 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-changed-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:29:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-640e4f52-98ac-4e74-bf75-b116ec9bc35e req-19af109d-e7ba-41b0-9747-a40be724b5c0 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Refreshing instance network info cache due to event network-changed-d74fbdec-d4bb-4577-bcdc-5eec41374f07. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:29:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-640e4f52-98ac-4e74-bf75-b116ec9bc35e req-19af109d-e7ba-41b0-9747-a40be724b5c0 service nova] Acquiring lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:29:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-640e4f52-98ac-4e74-bf75-b116ec9bc35e req-19af109d-e7ba-41b0-9747-a40be724b5c0 service nova] Acquired lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:29:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-640e4f52-98ac-4e74-bf75-b116ec9bc35e req-19af109d-e7ba-41b0-9747-a40be724b5c0 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Refreshing network info cache for port d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:29:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-640e4f52-98ac-4e74-bf75-b116ec9bc35e req-19af109d-e7ba-41b0-9747-a40be724b5c0 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updated VIF entry in instance network info cache for port d74fbdec-d4bb-4577-bcdc-5eec41374f07. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:29:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-640e4f52-98ac-4e74-bf75-b116ec9bc35e req-19af109d-e7ba-41b0-9747-a40be724b5c0 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updating instance_info_cache with network_info: [{"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:29:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-640e4f52-98ac-4e74-bf75-b116ec9bc35e req-19af109d-e7ba-41b0-9747-a40be724b5c0 service nova] Releasing lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:29:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:29:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:16 user nova-compute[74658]: INFO nova.compute.manager [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Detaching volume 117377d1-2f4a-48cd-8a28-4374d1d9e9de
Nov 16 15:29:16 user nova-compute[74658]: INFO nova.virt.block_device [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Attempting to driver detach volume 117377d1-2f4a-48cd-8a28-4374d1d9e9de from mountpoint /dev/vdb
Nov 16 15:29:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Attempting to detach device vdb from instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:29:16 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:29:16 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:29:16 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:29:16 user nova-compute[74658]:   <serial>117377d1-2f4a-48cd-8a28-4374d1d9e9de</serial>
Nov 16 15:29:16 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 15:29:16 user nova-compute[74658]: </disk>
Nov 16 15:29:16 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:29:16 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Successfully detached device vdb from instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae from the persistent domain config.
Nov 16 15:29:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:29:16 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:29:16 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:29:16 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:29:16 user nova-compute[74658]:   <serial>117377d1-2f4a-48cd-8a28-4374d1d9e9de</serial>
Nov 16 15:29:16 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 15:29:16 user nova-compute[74658]: </disk>
Nov 16 15:29:16 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-8f0668e0-2cd4-425a-8ca0-165d707f2645 req-a74431c6-33fa-4a28-a327-52eef4e37205 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-changed-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-8f0668e0-2cd4-425a-8ca0-165d707f2645 req-a74431c6-33fa-4a28-a327-52eef4e37205 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Refreshing instance network info cache due to event network-changed-d74fbdec-d4bb-4577-bcdc-5eec41374f07. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8f0668e0-2cd4-425a-8ca0-165d707f2645 req-a74431c6-33fa-4a28-a327-52eef4e37205 service nova] Acquiring lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8f0668e0-2cd4-425a-8ca0-165d707f2645 req-a74431c6-33fa-4a28-a327-52eef4e37205 service nova] Acquired lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-8f0668e0-2cd4-425a-8ca0-165d707f2645 req-a74431c6-33fa-4a28-a327-52eef4e37205 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Refreshing network info cache for port d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-8f0668e0-2cd4-425a-8ca0-165d707f2645 req-a74431c6-33fa-4a28-a327-52eef4e37205 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updated VIF entry in instance network info cache for port d74fbdec-d4bb-4577-bcdc-5eec41374f07. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-8f0668e0-2cd4-425a-8ca0-165d707f2645 req-a74431c6-33fa-4a28-a327-52eef4e37205 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updating instance_info_cache with network_info: [{"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:29:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8f0668e0-2cd4-425a-8ca0-165d707f2645 req-a74431c6-33fa-4a28-a327-52eef4e37205 service nova] Releasing lock "refresh_cache-38ff00d1-ed55-4b2e-8578-7d23241b14ae" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:29:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:29:35 user nova-compute[74658]: INFO nova.compute.claims [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Claim successful on node user
Nov 16 15:29:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG nova.network.neutron [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:29:35 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:29:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG nova.policy [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '366e499875f84191b530cb66cc0ed9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f2a06d6c0433a9846b31ff1c5ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:29:35 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Creating image(s)
Nov 16 15:29:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "/opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "/opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "/opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.164s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk 1073741824" returned: 0 in 0.050s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.165s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG nova.network.neutron [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Successfully created port: 1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Cannot resize image /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Ensure instance console log exists: /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:36 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae is timed out.
Nov 16 15:29:36 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Successfully detached device vdb from instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae from the live domain config.
Nov 16 15:29:36 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qunzHBNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:29:36 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3372b8ba-1a93-41bf-b35b-9b5d253520f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:29:36 user nova-compute[74658]: No targets found.
Nov 16 15:29:36 user nova-compute[74658]: iSNS:
Nov 16 15:29:36 user nova-compute[74658]: No targets found.
Nov 16 15:29:36 user nova-compute[74658]: STATIC:
Nov 16 15:29:36 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11
Nov 16 15:29:36 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:29:36 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:29:36 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de
Nov 16 15:29:36 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:29:36 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:29:36 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a
Nov 16 15:29:36 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:29:36 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:29:36 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44
Nov 16 15:29:36 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:29:36 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:29:36 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7
Nov 16 15:29:36 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:29:36 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:29:36 user nova-compute[74658]: FIRMWARE:
Nov 16 15:29:36 user nova-compute[74658]: No targets found.
Nov 16 15:29:36 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:29:36 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:29:36 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6310de2-75d0-453e-acc0-18f80a006599]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db88e7f-a048-47f7-9518-df8841b18065]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:29:36 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:29:36 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:29:36 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:29:36 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:29:36 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de (non-flash)
Nov 16 15:29:36 user nova-compute[74658]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:29:36 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:29:36 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:29:36 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:29:36 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710631b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74c65a3-9446-4750-96c4-52bda3907ebf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[341ea840-b619-4fd1-a97b-bd3f3a72d3ca]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f20a2b9-8e9e-4779-a690-94dedcb28b22]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8fcef1-8dac-4d82-a7db-86f245be5d89]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c80d18-bbcd-42de-9d2b-b9758a647e64]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc595f6-18bb-41d8-b1cf-5a5131d7fb85]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260]
Nov 16 15:29:36 user nova-compute[74658]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de, portal: 172.16.0.220,3260] successful.
Nov 16 15:29:36 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117377d1-2f4a-48cd-8a28-4374d1d9e9de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[82306089-947d-4171-9641-5bd9e8fcdfec]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] <== disconnect_volume: return (336ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:29:36 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Successfully updated port: 1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "refresh_cache-456b73b3-0723-4faa-8a7e-8f25fa0ead66" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquired lock "refresh_cache-456b73b3-0723-4faa-8a7e-8f25fa0ead66" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-dc9d21e7-8ec9-45f9-bd8e-3cb71d62b373 req-b98aabb3-4848-46c1-8d10-c22fe8649dc5 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Received event network-changed-1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-dc9d21e7-8ec9-45f9-bd8e-3cb71d62b373 req-b98aabb3-4848-46c1-8d10-c22fe8649dc5 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Refreshing instance network info cache due to event network-changed-1614ff1d-154e-41f7-b5ba-d6b95265a493. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dc9d21e7-8ec9-45f9-bd8e-3cb71d62b373 req-b98aabb3-4848-46c1-8d10-c22fe8649dc5 service nova] Acquiring lock "refresh_cache-456b73b3-0723-4faa-8a7e-8f25fa0ead66" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Updating instance_info_cache with network_info: [{"id": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "address": "fa:16:3e:12:7e:ee", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1614ff1d-15", "ovs_interfaceid": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Releasing lock "refresh_cache-456b73b3-0723-4faa-8a7e-8f25fa0ead66" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Instance network_info: |[{"id": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "address": "fa:16:3e:12:7e:ee", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1614ff1d-15", "ovs_interfaceid": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dc9d21e7-8ec9-45f9-bd8e-3cb71d62b373 req-b98aabb3-4848-46c1-8d10-c22fe8649dc5 service nova] Acquired lock "refresh_cache-456b73b3-0723-4faa-8a7e-8f25fa0ead66" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.network.neutron [req-dc9d21e7-8ec9-45f9-bd8e-3cb71d62b373 req-b98aabb3-4848-46c1-8d10-c22fe8649dc5 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Refreshing network info cache for port 1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Start _get_guest_xml network_info=[{"id": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "address": "fa:16:3e:12:7e:ee", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1614ff1d-15", "ovs_interfaceid": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:29:37 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:29:37 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-854995960',display_name='tempest-VolumesActionsTest-instance-854995960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-854995960',id=30,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='315f2a06d6c0433a9846b31ff1c5ab34',ramdisk_id='',reservation_id='r-oy4flr9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-330921490',owner_user_name='tempest-VolumesActionsTest-330921490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:29:36Z,user_data=None,user_id='366e499875f84191b530cb66cc0ed9dd',uuid=456b73b3-0723-4faa-8a7e-8f25fa0ead66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "address": "fa:16:3e:12:7e:ee", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1614ff1d-15", "ovs_interfaceid": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converting VIF {"id": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "address": "fa:16:3e:12:7e:ee", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1614ff1d-15", "ovs_interfaceid": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:7e:ee,bridge_name='br-int',has_traffic_filtering=True,id=1614ff1d-154e-41f7-b5ba-d6b95265a493,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1614ff1d-15') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.objects.instance [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lazy-loading 'pci_devices' on Instance uuid 456b73b3-0723-4faa-8a7e-8f25fa0ead66 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:29:37 user nova-compute[74658]:   <uuid>456b73b3-0723-4faa-8a7e-8f25fa0ead66</uuid>
Nov 16 15:29:37 user nova-compute[74658]:   <name>instance-0000001e</name>
Nov 16 15:29:37 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:29:37 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:29:37 user nova-compute[74658]:   <metadata>
Nov 16 15:29:37 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:29:37 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:29:37 user nova-compute[74658]:       <nova:name>tempest-VolumesActionsTest-instance-854995960</nova:name>
Nov 16 15:29:37 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:29:37</nova:creationTime>
Nov 16 15:29:37 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:29:37 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:29:37 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:29:37 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:29:37 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:29:37 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:29:37 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:29:37 user nova-compute[74658]:       <nova:owner>
Nov 16 15:29:37 user nova-compute[74658]:         <nova:user uuid="366e499875f84191b530cb66cc0ed9dd">tempest-VolumesActionsTest-330921490-project-member</nova:user>
Nov 16 15:29:37 user nova-compute[74658]:         <nova:project uuid="315f2a06d6c0433a9846b31ff1c5ab34">tempest-VolumesActionsTest-330921490</nova:project>
Nov 16 15:29:37 user nova-compute[74658]:       </nova:owner>
Nov 16 15:29:37 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:29:37 user nova-compute[74658]:       <nova:ports>
Nov 16 15:29:37 user nova-compute[74658]:         <nova:port uuid="1614ff1d-154e-41f7-b5ba-d6b95265a493">
Nov 16 15:29:37 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 15:29:37 user nova-compute[74658]:         </nova:port>
Nov 16 15:29:37 user nova-compute[74658]:       </nova:ports>
Nov 16 15:29:37 user nova-compute[74658]:     </nova:instance>
Nov 16 15:29:37 user nova-compute[74658]:   </metadata>
Nov 16 15:29:37 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:29:37 user nova-compute[74658]:     <system>
Nov 16 15:29:37 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:29:37 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:29:37 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:29:37 user nova-compute[74658]:       <entry name="serial">456b73b3-0723-4faa-8a7e-8f25fa0ead66</entry>
Nov 16 15:29:37 user nova-compute[74658]:       <entry name="uuid">456b73b3-0723-4faa-8a7e-8f25fa0ead66</entry>
Nov 16 15:29:37 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:29:37 user nova-compute[74658]:     </system>
Nov 16 15:29:37 user nova-compute[74658]:   </sysinfo>
Nov 16 15:29:37 user nova-compute[74658]:   <os>
Nov 16 15:29:37 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:29:37 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:29:37 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:29:37 user nova-compute[74658]:   </os>
Nov 16 15:29:37 user nova-compute[74658]:   <features>
Nov 16 15:29:37 user nova-compute[74658]:     <acpi/>
Nov 16 15:29:37 user nova-compute[74658]:     <apic/>
Nov 16 15:29:37 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:29:37 user nova-compute[74658]:   </features>
Nov 16 15:29:37 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:29:37 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:29:37 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:29:37 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:29:37 user nova-compute[74658]:   </clock>
Nov 16 15:29:37 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:29:37 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:29:37 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:29:37 user nova-compute[74658]:   </cpu>
Nov 16 15:29:37 user nova-compute[74658]:   <devices>
Nov 16 15:29:37 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:29:37 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:29:37 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk"/>
Nov 16 15:29:37 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:29:37 user nova-compute[74658]:     </disk>
Nov 16 15:29:37 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:29:37 user nova-compute[74658]:       <mac address="fa:16:3e:12:7e:ee"/>
Nov 16 15:29:37 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:29:37 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:29:37 user nova-compute[74658]:       <target dev="tap1614ff1d-15"/>
Nov 16 15:29:37 user nova-compute[74658]:     </interface>
Nov 16 15:29:37 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:29:37 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/console.log" append="off"/>
Nov 16 15:29:37 user nova-compute[74658]:     </serial>
Nov 16 15:29:37 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:29:37 user nova-compute[74658]:     <video>
Nov 16 15:29:37 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:29:37 user nova-compute[74658]:     </video>
Nov 16 15:29:37 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:29:37 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:29:37 user nova-compute[74658]:     </rng>
Nov 16 15:29:37 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:29:37 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:29:37 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:29:37 user nova-compute[74658]:     </memballoon>
Nov 16 15:29:37 user nova-compute[74658]:   </devices>
Nov 16 15:29:37 user nova-compute[74658]: </domain>
Nov 16 15:29:37 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-854995960',display_name='tempest-VolumesActionsTest-instance-854995960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-854995960',id=30,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='315f2a06d6c0433a9846b31ff1c5ab34',ramdisk_id='',reservation_id='r-oy4flr9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-330921490',owner_user_name='tempest-VolumesActionsTest-330921490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:29:36Z,user_data=None,user_id='366e499875f84191b530cb66cc0ed9dd',uuid=456b73b3-0723-4faa-8a7e-8f25fa0ead66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "address": "fa:16:3e:12:7e:ee", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1614ff1d-15", "ovs_interfaceid": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converting VIF {"id": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "address": "fa:16:3e:12:7e:ee", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1614ff1d-15", "ovs_interfaceid": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:7e:ee,bridge_name='br-int',has_traffic_filtering=True,id=1614ff1d-154e-41f7-b5ba-d6b95265a493,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1614ff1d-15') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG os_vif [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:7e:ee,bridge_name='br-int',has_traffic_filtering=True,id=1614ff1d-154e-41f7-b5ba-d6b95265a493,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1614ff1d-15') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb385d92-b713-5fdc-8e56-34f948b47377', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1614ff1d-15, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1614ff1d-15, col_values=(('qos', UUID('50f99505-a5c9-491b-9f70-e959244e1449')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1614ff1d-15, col_values=(('external_ids', {'iface-id': '1614ff1d-154e-41f7-b5ba-d6b95265a493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:7e:ee', 'vm-uuid': '456b73b3-0723-4faa-8a7e-8f25fa0ead66'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:37 user nova-compute[74658]: INFO os_vif [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:7e:ee,bridge_name='br-int',has_traffic_filtering=True,id=1614ff1d-154e-41f7-b5ba-d6b95265a493,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1614ff1d-15')
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] No VIF found with MAC fa:16:3e:12:7e:ee, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.objects.instance [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'flavor' on Instance uuid 38ff00d1-ed55-4b2e-8578-7d23241b14ae {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-f2897128-f768-41a8-8e10-e1298e59690e tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.704s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.network.neutron [req-dc9d21e7-8ec9-45f9-bd8e-3cb71d62b373 req-b98aabb3-4848-46c1-8d10-c22fe8649dc5 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Updated VIF entry in instance network info cache for port 1614ff1d-154e-41f7-b5ba-d6b95265a493. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG nova.network.neutron [req-dc9d21e7-8ec9-45f9-bd8e-3cb71d62b373 req-b98aabb3-4848-46c1-8d10-c22fe8649dc5 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Updating instance_info_cache with network_info: [{"id": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "address": "fa:16:3e:12:7e:ee", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1614ff1d-15", "ovs_interfaceid": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:29:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dc9d21e7-8ec9-45f9-bd8e-3cb71d62b373 req-b98aabb3-4848-46c1-8d10-c22fe8649dc5 service nova] Releasing lock "refresh_cache-456b73b3-0723-4faa-8a7e-8f25fa0ead66" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:29:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-e61b0094-6d89-4fdb-9d8c-9cf06f798484 req-1f1bc854-baca-444e-8560-eb4bc2cfcdd5 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Received event network-vif-plugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:29:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e61b0094-6d89-4fdb-9d8c-9cf06f798484 req-1f1bc854-baca-444e-8560-eb4bc2cfcdd5 service nova] Acquiring lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e61b0094-6d89-4fdb-9d8c-9cf06f798484 req-1f1bc854-baca-444e-8560-eb4bc2cfcdd5 service nova] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e61b0094-6d89-4fdb-9d8c-9cf06f798484 req-1f1bc854-baca-444e-8560-eb4bc2cfcdd5 service nova] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-e61b0094-6d89-4fdb-9d8c-9cf06f798484 req-1f1bc854-baca-444e-8560-eb4bc2cfcdd5 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] No waiting events found dispatching network-vif-plugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:29:39 user nova-compute[74658]: WARNING nova.compute.manager [req-e61b0094-6d89-4fdb-9d8c-9cf06f798484 req-1f1bc854-baca-444e-8560-eb4bc2cfcdd5 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Received unexpected event network-vif-plugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 for instance with vm_state building and task_state spawning.
Nov 16 15:29:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.compute.manager [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:29:41 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Instance spawned successfully.
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:29:41 user nova-compute[74658]: INFO nova.compute.manager [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.compute.manager [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.compute.manager [req-c0183167-cccd-4839-8900-6eda75dfadb9 req-3c57d1ec-8165-4d1f-a811-b8634b9afe83 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Received event network-vif-plugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0183167-cccd-4839-8900-6eda75dfadb9 req-3c57d1ec-8165-4d1f-a811-b8634b9afe83 service nova] Acquiring lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0183167-cccd-4839-8900-6eda75dfadb9 req-3c57d1ec-8165-4d1f-a811-b8634b9afe83 service nova] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0183167-cccd-4839-8900-6eda75dfadb9 req-3c57d1ec-8165-4d1f-a811-b8634b9afe83 service nova] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:41 user nova-compute[74658]: DEBUG nova.compute.manager [req-c0183167-cccd-4839-8900-6eda75dfadb9 req-3c57d1ec-8165-4d1f-a811-b8634b9afe83 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] No waiting events found dispatching network-vif-plugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:29:41 user nova-compute[74658]: WARNING nova.compute.manager [req-c0183167-cccd-4839-8900-6eda75dfadb9 req-3c57d1ec-8165-4d1f-a811-b8634b9afe83 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Received unexpected event network-vif-plugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 for instance with vm_state building and task_state spawning.
Nov 16 15:29:41 user nova-compute[74658]: INFO nova.compute.manager [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Took 6.19 seconds to build instance.
Nov 16 15:29:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-51607281-2f33-4674-89eb-70da6539d57a tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.286s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-49e6f012-c06f-4f06-8b38-d466cde38767 req-9e2e40c3-16e4-4e38-aee2-b02ae3bbb8c3 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Received event network-changed-2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:29:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-49e6f012-c06f-4f06-8b38-d466cde38767 req-9e2e40c3-16e4-4e38-aee2-b02ae3bbb8c3 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Refreshing instance network info cache due to event network-changed-2194e788-132c-48bc-a46b-15b811535723. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:29:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-49e6f012-c06f-4f06-8b38-d466cde38767 req-9e2e40c3-16e4-4e38-aee2-b02ae3bbb8c3 service nova] Acquiring lock "refresh_cache-5834c073-5392-40f8-bd69-8e7b50cd42ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:29:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-49e6f012-c06f-4f06-8b38-d466cde38767 req-9e2e40c3-16e4-4e38-aee2-b02ae3bbb8c3 service nova] Acquired lock "refresh_cache-5834c073-5392-40f8-bd69-8e7b50cd42ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:29:49 user nova-compute[74658]: DEBUG nova.network.neutron [req-49e6f012-c06f-4f06-8b38-d466cde38767 req-9e2e40c3-16e4-4e38-aee2-b02ae3bbb8c3 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Refreshing network info cache for port 2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:29:49 user nova-compute[74658]: DEBUG nova.network.neutron [req-49e6f012-c06f-4f06-8b38-d466cde38767 req-9e2e40c3-16e4-4e38-aee2-b02ae3bbb8c3 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Updated VIF entry in instance network info cache for port 2194e788-132c-48bc-a46b-15b811535723. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:29:49 user nova-compute[74658]: DEBUG nova.network.neutron [req-49e6f012-c06f-4f06-8b38-d466cde38767 req-9e2e40c3-16e4-4e38-aee2-b02ae3bbb8c3 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Updating instance_info_cache with network_info: [{"id": "2194e788-132c-48bc-a46b-15b811535723", "address": "fa:16:3e:cc:f7:ca", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2194e788-13", "ovs_interfaceid": "2194e788-132c-48bc-a46b-15b811535723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:29:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-49e6f012-c06f-4f06-8b38-d466cde38767 req-9e2e40c3-16e4-4e38-aee2-b02ae3bbb8c3 service nova] Releasing lock "refresh_cache-5834c073-5392-40f8-bd69-8e7b50cd42ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:29:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "03a85a50-fb48-414a-abb2-7e03a3423d14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:29:55 user nova-compute[74658]: INFO nova.compute.claims [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Claim successful on node user
Nov 16 15:29:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:29:55 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:29:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG nova.network.neutron [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:29:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:29:55 user nova-compute[74658]: INFO nova.virt.block_device [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Booting with volume snapshot b6f6c769-725e-4fba-a42c-b470642251fc at /dev/vda
Nov 16 15:29:56 user nova-compute[74658]: DEBUG nova.policy [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aed7ea9505b3400ebbe1ce456419bc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2156886e7c2247e38a1ffe4025798a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:29:56 user nova-compute[74658]: DEBUG nova.network.neutron [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Successfully created port: 2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:29:57 user nova-compute[74658]: DEBUG nova.network.neutron [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Successfully updated port: 2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:29:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "refresh_cache-03a85a50-fb48-414a-abb2-7e03a3423d14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:29:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquired lock "refresh_cache-03a85a50-fb48-414a-abb2-7e03a3423d14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:29:57 user nova-compute[74658]: DEBUG nova.network.neutron [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:29:57 user nova-compute[74658]: DEBUG nova.compute.manager [req-3ce92cb2-9354-4e2d-a165-28c119662033 req-b483f329-a12c-4698-854a-f0a30d30ee8f service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Received event network-changed-2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:29:57 user nova-compute[74658]: DEBUG nova.compute.manager [req-3ce92cb2-9354-4e2d-a165-28c119662033 req-b483f329-a12c-4698-854a-f0a30d30ee8f service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Refreshing instance network info cache due to event network-changed-2bfac405-c913-4039-b536-6766651df18f. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:29:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3ce92cb2-9354-4e2d-a165-28c119662033 req-b483f329-a12c-4698-854a-f0a30d30ee8f service nova] Acquiring lock "refresh_cache-03a85a50-fb48-414a-abb2-7e03a3423d14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:29:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:29:57 user nova-compute[74658]: DEBUG nova.network.neutron [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:29:58 user nova-compute[74658]: DEBUG nova.network.neutron [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Updating instance_info_cache with network_info: [{"id": "2bfac405-c913-4039-b536-6766651df18f", "address": "fa:16:3e:e3:92:bb", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfac405-c9", "ovs_interfaceid": "2bfac405-c913-4039-b536-6766651df18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:29:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Releasing lock "refresh_cache-03a85a50-fb48-414a-abb2-7e03a3423d14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:29:58 user nova-compute[74658]: DEBUG nova.compute.manager [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Instance network_info: |[{"id": "2bfac405-c913-4039-b536-6766651df18f", "address": "fa:16:3e:e3:92:bb", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfac405-c9", "ovs_interfaceid": "2bfac405-c913-4039-b536-6766651df18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:29:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3ce92cb2-9354-4e2d-a165-28c119662033 req-b483f329-a12c-4698-854a-f0a30d30ee8f service nova] Acquired lock "refresh_cache-03a85a50-fb48-414a-abb2-7e03a3423d14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:29:58 user nova-compute[74658]: DEBUG nova.network.neutron [req-3ce92cb2-9354-4e2d-a165-28c119662033 req-b483f329-a12c-4698-854a-f0a30d30ee8f service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Refreshing network info cache for port 2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:29:58 user nova-compute[74658]: DEBUG nova.network.neutron [req-3ce92cb2-9354-4e2d-a165-28c119662033 req-b483f329-a12c-4698-854a-f0a30d30ee8f service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Updated VIF entry in instance network info cache for port 2bfac405-c913-4039-b536-6766651df18f. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:29:58 user nova-compute[74658]: DEBUG nova.network.neutron [req-3ce92cb2-9354-4e2d-a165-28c119662033 req-b483f329-a12c-4698-854a-f0a30d30ee8f service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Updating instance_info_cache with network_info: [{"id": "2bfac405-c913-4039-b536-6766651df18f", "address": "fa:16:3e:e3:92:bb", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfac405-c9", "ovs_interfaceid": "2bfac405-c913-4039-b536-6766651df18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:29:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3ce92cb2-9354-4e2d-a165-28c119662033 req-b483f329-a12c-4698-854a-f0a30d30ee8f service nova] Releasing lock "refresh_cache-03a85a50-fb48-414a-abb2-7e03a3423d14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:30:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:30:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:00 user nova-compute[74658]: INFO nova.compute.manager [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Rescuing
Nov 16 15:30:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:30:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquired lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:30:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG nova.network.neutron [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Updating instance_info_cache with network_info: [{"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Releasing lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG os_brick.utils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-0710d1ef-b4ad-466e-a3e2-cb214f6e5c53 req-81af3bfe-8260-4d5f-b874-e90230476ad7 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-unplugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0710d1ef-b4ad-466e-a3e2-cb214f6e5c53 req-81af3bfe-8260-4d5f-b874-e90230476ad7 service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0710d1ef-b4ad-466e-a3e2-cb214f6e5c53 req-81af3bfe-8260-4d5f-b874-e90230476ad7 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0710d1ef-b4ad-466e-a3e2-cb214f6e5c53 req-81af3bfe-8260-4d5f-b874-e90230476ad7 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-0710d1ef-b4ad-466e-a3e2-cb214f6e5c53 req-81af3bfe-8260-4d5f-b874-e90230476ad7 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-unplugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:01 user nova-compute[74658]: WARNING nova.compute.manager [req-0710d1ef-b4ad-466e-a3e2-cb214f6e5c53 req-81af3bfe-8260-4d5f-b874-e90230476ad7 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received unexpected event network-vif-unplugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with vm_state active and task_state rescuing.
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[718e1eb9-475a-4d45-a061-39603c1e67ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e16f8a-3b9c-4dcb-ae25-9f9b39b2d6f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff4d5d9-b15a-47b6-821a-d098cb646437]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afc36c8-c20f-4b2c-86f1-3ae408e89400]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:30:01 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:30:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bc944b-45b4-4b11-8489-d525c7c9886a]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG os_brick.utils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:30:01 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Updating existing volume attachment record: c3d0e12b-b188-4aac-ab8d-380469859dbf {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:30:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Instance destroyed successfully.
Nov 16 15:30:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Attempting a stable device rescue
Nov 16 15:30:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74658) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Instance directory exists: not creating {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 15:30:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Creating image(s)
Nov 16 15:30:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "/opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "/opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'trusted_certs' on Instance uuid b6a0ca45-19d0-4644-8e65-fe904d85e1c1 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "bb6ecafd2525826c9fb07902949999d5b3c272c4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "bb6ecafd2525826c9fb07902949999d5b3c272c4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:30:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4.part --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4.part --force-share --output=json" returned: 0 in 0.229s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG nova.virt.images [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] fa4228c0-1264-45b6-9781-2bd18f10a6ac was qcow2, converting to raw {{(pid=74658) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4.part /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4.converted {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Updating instance_info_cache with network_info: [{"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-766f2096-3fe3-4d6f-93cd-2a07c8967197" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4.part /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4.converted" returned: 0 in 0.425s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4.converted --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-c602cd43-5bfc-48be-94ed-16cd0208978c req-5aec5fc1-05e4-4c24-8130-53f530e53b4c service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c602cd43-5bfc-48be-94ed-16cd0208978c req-5aec5fc1-05e4-4c24-8130-53f530e53b4c service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c602cd43-5bfc-48be-94ed-16cd0208978c req-5aec5fc1-05e4-4c24-8130-53f530e53b4c service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c602cd43-5bfc-48be-94ed-16cd0208978c req-5aec5fc1-05e4-4c24-8130-53f530e53b4c service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-c602cd43-5bfc-48be-94ed-16cd0208978c req-5aec5fc1-05e4-4c24-8130-53f530e53b4c service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:03 user nova-compute[74658]: WARNING nova.compute.manager [req-c602cd43-5bfc-48be-94ed-16cd0208978c req-5aec5fc1-05e4-4c24-8130-53f530e53b4c service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received unexpected event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with vm_state active and task_state rescuing.
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "bb6ecafd2525826c9fb07902949999d5b3c272c4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.846s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "bb6ecafd2525826c9fb07902949999d5b3c272c4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "bb6ecafd2525826c9fb07902949999d5b3c272c4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4 --force-share --output=json" returned: 0 in 0.190s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4,backing_fmt=raw /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.rescue {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4,backing_fmt=raw /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.rescue" returned: 0 in 0.046s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "bb6ecafd2525826c9fb07902949999d5b3c272c4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'migration_context' on Instance uuid b6a0ca45-19d0-4644-8e65-fe904d85e1c1 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.objects.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Object Instance<b6a0ca45-19d0-4644-8e65-fe904d85e1c1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Start _get_guest_xml network_info=[{"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "vif_mac": "fa:16:3e:4d:7d:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fa4228c0-1264-45b6-9781-2bd18f10a6ac', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5ba6a205-3579-4422-95e3-18b0671c3ec8', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhZyDBUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b6a0ca45-19d0-4644-8e65-fe904d85e1c1', 'attached_at': '', 'detached_at': '', 'volume_id': '5443b744-0bfd-453d-b6e9-c4a54605cb44', 'serial': '5443b744-0bfd-453d-b6e9-c4a54605cb44'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'resources' on Instance uuid b6a0ca45-19d0-4644-8e65-fe904d85e1c1 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.objects.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Object Instance<b6a0ca45-19d0-4644-8e65-fe904d85e1c1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'numa_topology' on Instance uuid b6a0ca45-19d0-4644-8e65-fe904d85e1c1 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.objects.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Object Instance<b6a0ca45-19d0-4644-8e65-fe904d85e1c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:30:04 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'vcpu_model' on Instance uuid b6a0ca45-19d0-4644-8e65-fe904d85e1c1 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.objects.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Object Instance<b6a0ca45-19d0-4644-8e65-fe904d85e1c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhZyDBUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:30:04 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:30:04 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:30:04 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[01407bdc-5510-453d-a8de-43a85c4d9f6a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = bhZyDBUP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 15:30:04 user nova-compute[74658]: node.name = iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44
Nov 16 15:30:04 user nova-compute[74658]: node.tpgt = -1
Nov 16 15:30:04 user nova-compute[74658]: node.startup = automatic
Nov 16 15:30:04 user nova-compute[74658]: node.leading_login = No
Nov 16 15:30:04 user nova-compute[74658]: iface.iscsi_ifacename = default
Nov 16 15:30:04 user nova-compute[74658]: iface.net_ifacename = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.ipaddress = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.prefix_len = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.hwaddress = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.transport_name = tcp
Nov 16 15:30:04 user nova-compute[74658]: iface.initiatorname = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.state = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.vlan_id = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.vlan_priority = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.vlan_state = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.iface_num = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.mtu = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.port = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.bootproto = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.subnet_mask = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.gateway = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.dhcp_alt_client_id = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.dhcp_dns = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.dhcp_learn_iqn = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.dhcp_vendor_id_state = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.dhcp_vendor_id = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.dhcp_slp_da = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.fragmentation = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.gratuitous_arp = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.incoming_forwarding = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.tos_state = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.tos = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.ttl = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.delayed_ack = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.tcp_nagle = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.tcp_wsf_state = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.tcp_wsf = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.tcp_timer_scale = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.tcp_timestamp = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.redirect = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.def_task_mgmt_timeout = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.header_digest = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.data_digest = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.immediate_data = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.initial_r2t = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.data_seq_inorder = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.data_pdu_inorder = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.erl = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.max_receive_data_len = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.first_burst_len = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.max_outstanding_r2t = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.max_burst_len = 0
Nov 16 15:30:04 user nova-compute[74658]: iface.chap_auth = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.bidi_chap = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.strict_login_compliance = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.discovery_auth = <empty>
Nov 16 15:30:04 user nova-compute[74658]: iface.discovery_logout = <empty>
Nov 16 15:30:04 user nova-compute[74658]: node.discovery_address = <empty>
Nov 16 15:30:04 user nova-compute[74658]: node.discovery_port = 0
Nov 16 15:30:04 user nova-compute[74658]: node.discovery_type = static
Nov 16 15:30:04 user nova-compute[74658]: node.session.initial_cmdsn = 0
Nov 16 15:30:04 user nova-compute[74658]: node.session.initial_login_retry_max = 8
Nov 16 15:30:04 user nova-compute[74658]: node.session.xmit_thread_priority = -20
Nov 16 15:30:04 user nova-compute[74658]: node.session.cmds_max = 128
Nov 16 15:30:04 user nova-compute[74658]: node.session.queue_depth = 32
Nov 16 15:30:04 user nova-compute[74658]: node.session.nr_sessions = 1
Nov 16 15:30:04 user nova-compute[74658]: node.session.auth.authmethod = CHAP
Nov 16 15:30:04 user nova-compute[74658]: node.session.auth.username = bhZyDBUP
Nov 16 15:30:04 user nova-compute[74658]: node.session.auth.password = ***
Nov 16 15:30:04 user nova-compute[74658]: node.session.auth.username_in = <empty>
Nov 16 15:30:04 user nova-compute[74658]: node.session.auth.password_in = <empty>
Nov 16 15:30:04 user nova-compute[74658]: node.session.auth.chap_algs = MD5
Nov 16 15:30:04 user nova-compute[74658]: node.session.timeo.replacement_timeout = 120
Nov 16 15:30:04 user nova-compute[74658]: node.session.err_timeo.abort_timeout = 15
Nov 16 15:30:04 user nova-compute[74658]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 15:30:04 user nova-compute[74658]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 15:30:04 user nova-compute[74658]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 15:30:04 user nova-compute[74658]: node.session.iscsi.FastAbort = Yes
Nov 16 15:30:04 user nova-compute[74658]: node.session.iscsi.InitialR2T = No
Nov 16 15:30:04 user nova-compute[74658]: node.session.iscsi.ImmediateData = Yes
Nov 16 15:30:04 user nova-compute[74658]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 15:30:04 user nova-compute[74658]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 15:30:04 user nova-compute[74658]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 15:30:04 user nova-compute[74658]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 15:30:04 user nova-compute[74658]: node.session.iscsi.MaxConnections = 1
Nov 16 15:30:04 user nova-compute[74658]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 15:30:04 user nova-compute[74658]: node.session.iscsi.ERL = 0
Nov 16 15:30:04 user nova-compute[74658]: node.session.scan = manual
Nov 16 15:30:04 user nova-compute[74658]: node.session.reopen_max = 0
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].address = 172.16.0.220
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].port = 3260
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].startup = manual
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].tcp.window_size = 524288
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].tcp.type_of_service = 0
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].timeo.logout_timeout = 15
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].timeo.login_timeout = 15
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].timeo.auth_timeout = 45
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].iscsi.DataDigest = None
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].iscsi.IFMarker = No
Nov 16 15:30:04 user nova-compute[74658]: node.conn[0].iscsi.OFMarker = No
Nov 16 15:30:04 user nova-compute[74658]: # END RECORD
Nov 16 15:30:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[729cb8f1-31a4-4223-afcf-646732ac6b8a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[430ff17b-1359-41dd-afde-4da47c29817b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhZyDBUP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhZyDBUP" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd27c7-faa9-40d3-a660-d28930c1d691]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bhZyDBUP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8978c037-44b7-435f-8b24-a389ae48a9d6]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf647636-602d-4ff4-9979-931969003569]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:04 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:04 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:04 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:04 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:04 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:04 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] HCTL ('36', '0', '0', 0) found on session 32 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b2eb19-d4ae-4315-af57-617d9d980928]: (4, ('0 0 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Searching for a device in session 32 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhZyDBUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] <== connect_volume: return (207ms) {'type': 'block', 'scsi_wwn': '26331316135306235', 'path': '/dev/sde'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331316135306235', 'path': '/dev/sde'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2014300948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2014300948',id=28,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:28:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='621284eebf704320bacac96aedbc77a4',ramdisk_id='',reservation_id='r-ttx4gd15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:28:27Z,user_data=None,user_id='6ed5db501b2e4dcfb742e18dfdeae88b',uuid=b6a0ca45-19d0-4644-8e65-fe904d85e1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "vif_mac": "fa:16:3e:4d:7d:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converting VIF {"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "vif_mac": "fa:16:3e:4d:7d:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=54c165cd-1a44-4017-9b20-e2d1ebc02101,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c165cd-1a') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'pci_devices' on Instance uuid b6a0ca45-19d0-4644-8e65-fe904d85e1c1 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.objects.base [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Object Instance<b6a0ca45-19d0-4644-8e65-fe904d85e1c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:30:04 user nova-compute[74658]:   <uuid>b6a0ca45-19d0-4644-8e65-fe904d85e1c1</uuid>
Nov 16 15:30:04 user nova-compute[74658]:   <name>instance-0000001c</name>
Nov 16 15:30:04 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:30:04 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:30:04 user nova-compute[74658]:   <metadata>
Nov 16 15:30:04 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:30:04 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:30:04 user nova-compute[74658]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2014300948</nova:name>
Nov 16 15:30:04 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:30:04</nova:creationTime>
Nov 16 15:30:04 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:30:04 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:30:04 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:30:04 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:30:04 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:30:04 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:30:04 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:30:04 user nova-compute[74658]:       <nova:owner>
Nov 16 15:30:04 user nova-compute[74658]:         <nova:user uuid="6ed5db501b2e4dcfb742e18dfdeae88b">tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member</nova:user>
Nov 16 15:30:04 user nova-compute[74658]:         <nova:project uuid="621284eebf704320bacac96aedbc77a4">tempest-ServerBootFromVolumeStableRescueTest-1170309652</nova:project>
Nov 16 15:30:04 user nova-compute[74658]:       </nova:owner>
Nov 16 15:30:04 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:30:04 user nova-compute[74658]:       <nova:ports>
Nov 16 15:30:04 user nova-compute[74658]:         <nova:port uuid="54c165cd-1a44-4017-9b20-e2d1ebc02101">
Nov 16 15:30:04 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 15:30:04 user nova-compute[74658]:         </nova:port>
Nov 16 15:30:04 user nova-compute[74658]:       </nova:ports>
Nov 16 15:30:04 user nova-compute[74658]:     </nova:instance>
Nov 16 15:30:04 user nova-compute[74658]:   </metadata>
Nov 16 15:30:04 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:30:04 user nova-compute[74658]:     <system>
Nov 16 15:30:04 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:30:04 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:30:04 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:30:04 user nova-compute[74658]:       <entry name="serial">b6a0ca45-19d0-4644-8e65-fe904d85e1c1</entry>
Nov 16 15:30:04 user nova-compute[74658]:       <entry name="uuid">b6a0ca45-19d0-4644-8e65-fe904d85e1c1</entry>
Nov 16 15:30:04 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:30:04 user nova-compute[74658]:     </system>
Nov 16 15:30:04 user nova-compute[74658]:   </sysinfo>
Nov 16 15:30:04 user nova-compute[74658]:   <os>
Nov 16 15:30:04 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:30:04 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:30:04 user nova-compute[74658]:   </os>
Nov 16 15:30:04 user nova-compute[74658]:   <features>
Nov 16 15:30:04 user nova-compute[74658]:     <acpi/>
Nov 16 15:30:04 user nova-compute[74658]:     <apic/>
Nov 16 15:30:04 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:30:04 user nova-compute[74658]:   </features>
Nov 16 15:30:04 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:30:04 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:30:04 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:30:04 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:30:04 user nova-compute[74658]:   </clock>
Nov 16 15:30:04 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:30:04 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:30:04 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:30:04 user nova-compute[74658]:   </cpu>
Nov 16 15:30:04 user nova-compute[74658]:   <devices>
Nov 16 15:30:04 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:30:04 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:30:04 user nova-compute[74658]:       <source dev="/dev/sde"/>
Nov 16 15:30:04 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:30:04 user nova-compute[74658]:       <serial>5443b744-0bfd-453d-b6e9-c4a54605cb44</serial>
Nov 16 15:30:04 user nova-compute[74658]:     </disk>
Nov 16 15:30:04 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:30:04 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:30:04 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.rescue"/>
Nov 16 15:30:04 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:30:04 user nova-compute[74658]:       <boot order="1"/>
Nov 16 15:30:04 user nova-compute[74658]:     </disk>
Nov 16 15:30:04 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:30:04 user nova-compute[74658]:       <mac address="fa:16:3e:4d:7d:8d"/>
Nov 16 15:30:04 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:30:04 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:30:04 user nova-compute[74658]:       <target dev="tap54c165cd-1a"/>
Nov 16 15:30:04 user nova-compute[74658]:     </interface>
Nov 16 15:30:04 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:30:04 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/console.log" append="off"/>
Nov 16 15:30:04 user nova-compute[74658]:     </serial>
Nov 16 15:30:04 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:30:04 user nova-compute[74658]:     <video>
Nov 16 15:30:04 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:30:04 user nova-compute[74658]:     </video>
Nov 16 15:30:04 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:30:04 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:30:04 user nova-compute[74658]:     </rng>
Nov 16 15:30:04 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:30:04 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:30:04 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:30:04 user nova-compute[74658]:     </memballoon>
Nov 16 15:30:04 user nova-compute[74658]:   </devices>
Nov 16 15:30:04 user nova-compute[74658]: </domain>
Nov 16 15:30:04 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:30:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Instance destroyed successfully.
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:30:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] No VIF found with MAC fa:16:3e:4d:7d:8d, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:30:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:30:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-392c929f-2308-4ff5-80f9-618fb27b0dd4 req-4808f3e3-baaa-4fe1-af40-42b64c43fe23 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392c929f-2308-4ff5-80f9-618fb27b0dd4 req-4808f3e3-baaa-4fe1-af40-42b64c43fe23 service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392c929f-2308-4ff5-80f9-618fb27b0dd4 req-4808f3e3-baaa-4fe1-af40-42b64c43fe23 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-392c929f-2308-4ff5-80f9-618fb27b0dd4 req-4808f3e3-baaa-4fe1-af40-42b64c43fe23 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-392c929f-2308-4ff5-80f9-618fb27b0dd4 req-4808f3e3-baaa-4fe1-af40-42b64c43fe23 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:06 user nova-compute[74658]: WARNING nova.compute.manager [req-392c929f-2308-4ff5-80f9-618fb27b0dd4 req-4808f3e3-baaa-4fe1-af40-42b64c43fe23 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received unexpected event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with vm_state active and task_state rescuing.
Nov 16 15:30:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:30:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:30:07 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Creating image(s)
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Ensure instance console log exists: /opt/stack/data/nova/instances/03a85a50-fb48-414a-abb2-7e03a3423d14/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Start _get_guest_xml network_info=[{"id": "2bfac405-c913-4039-b536-6766651df18f", "address": "fa:16:3e:e3:92:bb", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfac405-c9", "ovs_interfaceid": "2bfac405-c913-4039-b536-6766651df18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T15:29:51Z,direct_url=<?>,disk_format='qcow2',id=9bc0388b-096e-4141-86fc-02dfa0abd8f2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-444110276',owner='2156886e7c2247e38a1ffe4025798a96',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T15:29:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c3d0e12b-b188-4aac-ab8d-380469859dbf', 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlaMDRpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03a85a50-fb48-414a-abb2-7e03a3423d14', 'attached_at': '', 'detached_at': '', 'volume_id': '3a754835-1372-4389-9f8c-f3d780e06b2b', 'serial': '3a754835-1372-4389-9f8c-f3d780e06b2b'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:30:07 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:30:07 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T15:29:51Z,direct_url=<?>,disk_format='qcow2',id=9bc0388b-096e-4141-86fc-02dfa0abd8f2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-444110276',owner='2156886e7c2247e38a1ffe4025798a96',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T15:29:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlaMDRpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:30:07 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:30:07 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:30:07 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[807772f2-92d0-43e4-ae53-9015a9186caf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:30:07 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.056s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e021fb-7af6-475f-b2ea-facee56fff89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b] added
Nov 16 15:30:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0675ad20-edcc-4345-b88e-3c4c8c8876b3]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1130dae9-e97a-4dec-acbd-1e2945af7ec5]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jlaMDRpZ {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jlaMDRpZ" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc85caf4-f1e3-4cda-bfe4-ab92dac998cb]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jlaMDRpZ'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed385be-0584-4b41-82a7-48e5bc6134e2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[09903a8f-c446-489c-96ba-166cc0e5c399]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8436e609-217f-4909-8dba-2249cfc1fd9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b, portal: 172.16.0.220,3260]
Nov 16 15:30:07 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b, portal: 172.16.0.220,3260] successful.
Nov 16 15:30:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aeed55-e373-46ab-89f3-e8bfbabbe8a4]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c123a24-83dd-4c0b-b15e-1655b93dff44]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:07 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4c15d8-da05-4458-86c4-4658d25b162c]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlaMDRpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.654s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== connect_volume: return (1656ms) {'type': 'block', 'scsi_wwn': '23038353064643335', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038353064643335', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-04779ad9-2d98-42ee-9097-934e797c96a9 req-4f718436-a624-4417-9320-cdbcb527ab10 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-04779ad9-2d98-42ee-9097-934e797c96a9 req-4f718436-a624-4417-9320-cdbcb527ab10 service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-04779ad9-2d98-42ee-9097-934e797c96a9 req-4f718436-a624-4417-9320-cdbcb527ab10 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-04779ad9-2d98-42ee-9097-934e797c96a9 req-4f718436-a624-4417-9320-cdbcb527ab10 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-04779ad9-2d98-42ee-9097-934e797c96a9 req-4f718436-a624-4417-9320-cdbcb527ab10 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:09 user nova-compute[74658]: WARNING nova.compute.manager [req-04779ad9-2d98-42ee-9097-934e797c96a9 req-4f718436-a624-4417-9320-cdbcb527ab10 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received unexpected event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with vm_state active and task_state rescuing.
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-befe0739-579c-4079-815e-432ef0db054c tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:30:09 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:30:09 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7893MB free_disk=25.161396026611328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:09 user nova-compute[74658]: INFO nova.compute.manager [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Terminating instance
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1398418856',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1398418856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1398418856',id=31,image_ref='9bc0388b-096e-4141-86fc-02dfa0abd8f2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKovpO8PHwwK8fuB9/ZKmPWPhikJqMXbq7jyP1AYK8Tk1Ls5FQiLFrbVOtPWD/qFqAxQ+P9PyXs3G6fRZhrsBpNnmopfFPF8UwRQhieYX/Bs0Uly0JJ560j7VvGCDodg7A==',key_name='tempest-keypair-2030433190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-lafcmwz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1853010836',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=03a85a50-fb48-414a-abb2-7e03a3423d14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bfac405-c913-4039-b536-6766651df18f", "address": "fa:16:3e:e3:92:bb", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfac405-c9", "ovs_interfaceid": "2bfac405-c913-4039-b536-6766651df18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "2bfac405-c913-4039-b536-6766651df18f", "address": "fa:16:3e:e3:92:bb", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfac405-c9", "ovs_interfaceid": "2bfac405-c913-4039-b536-6766651df18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:92:bb,bridge_name='br-int',has_traffic_filtering=True,id=2bfac405-c913-4039-b536-6766651df18f,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfac405-c9') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.objects.instance [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'pci_devices' on Instance uuid 03a85a50-fb48-414a-abb2-7e03a3423d14 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:30:09 user nova-compute[74658]:   <uuid>03a85a50-fb48-414a-abb2-7e03a3423d14</uuid>
Nov 16 15:30:09 user nova-compute[74658]:   <name>instance-0000001f</name>
Nov 16 15:30:09 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:30:09 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:30:09 user nova-compute[74658]:   <metadata>
Nov 16 15:30:09 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:30:09 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:30:09 user nova-compute[74658]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1398418856</nova:name>
Nov 16 15:30:09 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:30:07</nova:creationTime>
Nov 16 15:30:09 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:30:09 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:30:09 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:30:09 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:30:09 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:30:09 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:30:09 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:30:09 user nova-compute[74658]:       <nova:owner>
Nov 16 15:30:09 user nova-compute[74658]:         <nova:user uuid="aed7ea9505b3400ebbe1ce456419bc82">tempest-TestVolumeBootPattern-1853010836-project-member</nova:user>
Nov 16 15:30:09 user nova-compute[74658]:         <nova:project uuid="2156886e7c2247e38a1ffe4025798a96">tempest-TestVolumeBootPattern-1853010836</nova:project>
Nov 16 15:30:09 user nova-compute[74658]:       </nova:owner>
Nov 16 15:30:09 user nova-compute[74658]:       <nova:root type="image" uuid="9bc0388b-096e-4141-86fc-02dfa0abd8f2"/>
Nov 16 15:30:09 user nova-compute[74658]:       <nova:ports>
Nov 16 15:30:09 user nova-compute[74658]:         <nova:port uuid="2bfac405-c913-4039-b536-6766651df18f">
Nov 16 15:30:09 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 15:30:09 user nova-compute[74658]:         </nova:port>
Nov 16 15:30:09 user nova-compute[74658]:       </nova:ports>
Nov 16 15:30:09 user nova-compute[74658]:     </nova:instance>
Nov 16 15:30:09 user nova-compute[74658]:   </metadata>
Nov 16 15:30:09 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:30:09 user nova-compute[74658]:     <system>
Nov 16 15:30:09 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:30:09 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:30:09 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:30:09 user nova-compute[74658]:       <entry name="serial">03a85a50-fb48-414a-abb2-7e03a3423d14</entry>
Nov 16 15:30:09 user nova-compute[74658]:       <entry name="uuid">03a85a50-fb48-414a-abb2-7e03a3423d14</entry>
Nov 16 15:30:09 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:30:09 user nova-compute[74658]:     </system>
Nov 16 15:30:09 user nova-compute[74658]:   </sysinfo>
Nov 16 15:30:09 user nova-compute[74658]:   <os>
Nov 16 15:30:09 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:30:09 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:30:09 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:30:09 user nova-compute[74658]:   </os>
Nov 16 15:30:09 user nova-compute[74658]:   <features>
Nov 16 15:30:09 user nova-compute[74658]:     <acpi/>
Nov 16 15:30:09 user nova-compute[74658]:     <apic/>
Nov 16 15:30:09 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:30:09 user nova-compute[74658]:   </features>
Nov 16 15:30:09 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:30:09 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:30:09 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:30:09 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:30:09 user nova-compute[74658]:   </clock>
Nov 16 15:30:09 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:30:09 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:30:09 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:30:09 user nova-compute[74658]:   </cpu>
Nov 16 15:30:09 user nova-compute[74658]:   <devices>
Nov 16 15:30:09 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:30:09 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:30:09 user nova-compute[74658]:       <source dev="/dev/sdc"/>
Nov 16 15:30:09 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:30:09 user nova-compute[74658]:       <serial>3a754835-1372-4389-9f8c-f3d780e06b2b</serial>
Nov 16 15:30:09 user nova-compute[74658]:     </disk>
Nov 16 15:30:09 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:30:09 user nova-compute[74658]:       <mac address="fa:16:3e:e3:92:bb"/>
Nov 16 15:30:09 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:30:09 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:30:09 user nova-compute[74658]:       <target dev="tap2bfac405-c9"/>
Nov 16 15:30:09 user nova-compute[74658]:     </interface>
Nov 16 15:30:09 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:30:09 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/03a85a50-fb48-414a-abb2-7e03a3423d14/console.log" append="off"/>
Nov 16 15:30:09 user nova-compute[74658]:     </serial>
Nov 16 15:30:09 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:30:09 user nova-compute[74658]:     <video>
Nov 16 15:30:09 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:30:09 user nova-compute[74658]:     </video>
Nov 16 15:30:09 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:30:09 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:30:09 user nova-compute[74658]:     </rng>
Nov 16 15:30:09 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:30:09 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:30:09 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:30:09 user nova-compute[74658]:     </memballoon>
Nov 16 15:30:09 user nova-compute[74658]:   </devices>
Nov 16 15:30:09 user nova-compute[74658]: </domain>
Nov 16 15:30:09 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1398418856',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1398418856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1398418856',id=31,image_ref='9bc0388b-096e-4141-86fc-02dfa0abd8f2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKovpO8PHwwK8fuB9/ZKmPWPhikJqMXbq7jyP1AYK8Tk1Ls5FQiLFrbVOtPWD/qFqAxQ+P9PyXs3G6fRZhrsBpNnmopfFPF8UwRQhieYX/Bs0Uly0JJ560j7VvGCDodg7A==',key_name='tempest-keypair-2030433190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-lafcmwz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1853010836',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=03a85a50-fb48-414a-abb2-7e03a3423d14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bfac405-c913-4039-b536-6766651df18f", "address": "fa:16:3e:e3:92:bb", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfac405-c9", "ovs_interfaceid": "2bfac405-c913-4039-b536-6766651df18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "2bfac405-c913-4039-b536-6766651df18f", "address": "fa:16:3e:e3:92:bb", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfac405-c9", "ovs_interfaceid": "2bfac405-c913-4039-b536-6766651df18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:92:bb,bridge_name='br-int',has_traffic_filtering=True,id=2bfac405-c913-4039-b536-6766651df18f,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfac405-c9') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG os_vif [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:92:bb,bridge_name='br-int',has_traffic_filtering=True,id=2bfac405-c913-4039-b536-6766651df18f,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfac405-c9') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7269b6b-8e49-5372-807b-b4bcbd389787', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bfac405-c9, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bfac405-c9, col_values=(('qos', UUID('c10a279c-6536-435e-810f-19e0f761a180')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bfac405-c9, col_values=(('external_ids', {'iface-id': '2bfac405-c913-4039-b536-6766651df18f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:92:bb', 'vm-uuid': '03a85a50-fb48-414a-abb2-7e03a3423d14'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:09 user nova-compute[74658]: INFO os_vif [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:92:bb,bridge_name='br-int',has_traffic_filtering=True,id=2bfac405-c913-4039-b536-6766651df18f,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfac405-c9')
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6c8dd806-c294-40dd-a13d-63659a1d5669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 97135af5-e020-482b-a54b-6cf30a5443d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 5834c073-5392-40f8-bd69-8e7b50cd42ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance b6a0ca45-19d0-4644-8e65-fe904d85e1c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 67d2aeee-7218-4e85-baa3-157643a4301e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 456b73b3-0723-4faa-8a7e-8f25fa0ead66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 03a85a50-fb48-414a-abb2-7e03a3423d14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No VIF found with MAC fa:16:3e:e3:92:bb, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-5e21d2ed-10d3-49c8-ac96-8ff6572b3b62 req-04279930-cfab-41eb-84f4-9fb97e324e9e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-vif-unplugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5e21d2ed-10d3-49c8-ac96-8ff6572b3b62 req-04279930-cfab-41eb-84f4-9fb97e324e9e service nova] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5e21d2ed-10d3-49c8-ac96-8ff6572b3b62 req-04279930-cfab-41eb-84f4-9fb97e324e9e service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5e21d2ed-10d3-49c8-ac96-8ff6572b3b62 req-04279930-cfab-41eb-84f4-9fb97e324e9e service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-5e21d2ed-10d3-49c8-ac96-8ff6572b3b62 req-04279930-cfab-41eb-84f4-9fb97e324e9e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] No waiting events found dispatching network-vif-unplugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-5e21d2ed-10d3-49c8-ac96-8ff6572b3b62 req-04279930-cfab-41eb-84f4-9fb97e324e9e service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-vif-unplugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:30:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.714s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Instance destroyed successfully.
Nov 16 15:30:10 user nova-compute[74658]: DEBUG nova.objects.instance [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'resources' on Instance uuid 38ff00d1-ed55-4b2e-8578-7d23241b14ae {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-815061819',display_name='tempest-TestMinimumBasicScenario-server-815061819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-815061819',id=23,image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdwvlnLLIm4nJfBEVS4gU9R+vVTf4AEKUWi4rXQcAbDUIvgksBJbbhGBylBHQTlNxwB5nPvGuYyloQbvUQheXMF4p00cira0X+myTFfLY/1UOCBmylgAYJ1qofW+bztkw==',key_name='tempest-TestMinimumBasicScenario-1953655943',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08549dcd4d26408098316f61ca4a6ee2',ramdisk_id='',reservation_id='r-nk6dncr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dfb8e0c-e009-4134-8758-6224175b38b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1910079629',owner_user_name='tempest-TestMinimumBasicScenario-1910079629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:27:30Z,user_data=None,user_id='d3cee7d0742148a1808713d978dbd01b',uuid=38ff00d1-ed55-4b2e-8578-7d23241b14ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converting VIF {"id": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "address": "fa:16:3e:48:94:b9", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74fbdec-d4", "ovs_interfaceid": "d74fbdec-d4bb-4577-bcdc-5eec41374f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG os_vif [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd74fbdec-d4, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c62f7705-05d7-425f-9778-b05d09f89acd) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:10 user nova-compute[74658]: INFO os_vif [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=d74fbdec-d4bb-4577-bcdc-5eec41374f07,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74fbdec-d4')
Nov 16 15:30:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Deleting instance files /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae_del
Nov 16 15:30:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Deletion of /opt/stack/data/nova/instances/38ff00d1-ed55-4b2e-8578-7d23241b14ae_del complete
Nov 16 15:30:10 user nova-compute[74658]: INFO nova.compute.manager [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Took 1.44 seconds to destroy the instance on the hypervisor.
Nov 16 15:30:10 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:30:10 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:30:11 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Took 0.62 seconds to deallocate network for instance.
Nov 16 15:30:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] Acquiring lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] No waiting events found dispatching network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:11 user nova-compute[74658]: WARNING nova.compute.manager [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received unexpected event network-vif-plugged-d74fbdec-d4bb-4577-bcdc-5eec41374f07 for instance with vm_state deleted and task_state None.
Nov 16 15:30:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] [instance: 38ff00d1-ed55-4b2e-8578-7d23241b14ae] Received event network-vif-deleted-d74fbdec-d4bb-4577-bcdc-5eec41374f07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Received event network-vif-plugged-2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] Acquiring lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] No waiting events found dispatching network-vif-plugged-2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:11 user nova-compute[74658]: WARNING nova.compute.manager [req-0ae51e8e-e40e-4732-b35e-625d9c347e9f req-8e400afc-dfca-4820-b0eb-641f8869a2a2 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Received unexpected event network-vif-plugged-2bfac405-c913-4039-b536-6766651df18f for instance with vm_state building and task_state spawning.
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:11 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Deleted allocations for instance 38ff00d1-ed55-4b2e-8578-7d23241b14ae
Nov 16 15:30:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7e10e717-07ed-4e93-b140-1889040e4e2f tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "38ff00d1-ed55-4b2e-8578-7d23241b14ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.696s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:30:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:30:13 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Instance spawned successfully.
Nov 16 15:30:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:30:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:30:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:30:13 user nova-compute[74658]: INFO nova.compute.manager [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 16 15:30:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:30:13 user nova-compute[74658]: INFO nova.compute.manager [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Took 18.35 seconds to build instance.
Nov 16 15:30:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-61dcdd32-65c7-4ca0-b5cc-f094ce58b433 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.444s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-048b45d9-75e8-47b0-bd64-925ebecb1d94 req-546b96ef-98b3-4dc0-b684-87f0b7e6ca77 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Received event network-vif-plugged-2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-048b45d9-75e8-47b0-bd64-925ebecb1d94 req-546b96ef-98b3-4dc0-b684-87f0b7e6ca77 service nova] Acquiring lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-048b45d9-75e8-47b0-bd64-925ebecb1d94 req-546b96ef-98b3-4dc0-b684-87f0b7e6ca77 service nova] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-048b45d9-75e8-47b0-bd64-925ebecb1d94 req-546b96ef-98b3-4dc0-b684-87f0b7e6ca77 service nova] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-048b45d9-75e8-47b0-bd64-925ebecb1d94 req-546b96ef-98b3-4dc0-b684-87f0b7e6ca77 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] No waiting events found dispatching network-vif-plugged-2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:13 user nova-compute[74658]: WARNING nova.compute.manager [req-048b45d9-75e8-47b0-bd64-925ebecb1d94 req-546b96ef-98b3-4dc0-b684-87f0b7e6ca77 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Received unexpected event network-vif-plugged-2bfac405-c913-4039-b536-6766651df18f for instance with vm_state active and task_state None.
Nov 16 15:30:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-c7c06a3a-4da1-4501-9c7a-3fc1e798efc0 req-152c038d-12ba-4429-b5a0-61f814356c93 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received event network-changed-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-c7c06a3a-4da1-4501-9c7a-3fc1e798efc0 req-152c038d-12ba-4429-b5a0-61f814356c93 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Refreshing instance network info cache due to event network-changed-4999888f-3310-45f7-bc33-8180b8110ef9. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:30:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7c06a3a-4da1-4501-9c7a-3fc1e798efc0 req-152c038d-12ba-4429-b5a0-61f814356c93 service nova] Acquiring lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:30:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7c06a3a-4da1-4501-9c7a-3fc1e798efc0 req-152c038d-12ba-4429-b5a0-61f814356c93 service nova] Acquired lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:30:20 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7c06a3a-4da1-4501-9c7a-3fc1e798efc0 req-152c038d-12ba-4429-b5a0-61f814356c93 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Refreshing network info cache for port 4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:30:21 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7c06a3a-4da1-4501-9c7a-3fc1e798efc0 req-152c038d-12ba-4429-b5a0-61f814356c93 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updated VIF entry in instance network info cache for port 4999888f-3310-45f7-bc33-8180b8110ef9. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:30:21 user nova-compute[74658]: DEBUG nova.network.neutron [req-c7c06a3a-4da1-4501-9c7a-3fc1e798efc0 req-152c038d-12ba-4429-b5a0-61f814356c93 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updating instance_info_cache with network_info: [{"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:30:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c7c06a3a-4da1-4501-9c7a-3fc1e798efc0 req-152c038d-12ba-4429-b5a0-61f814356c93 service nova] Releasing lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:30:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Stashing vm_state: active {{(pid=74658) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 15:30:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:30:22 user nova-compute[74658]: INFO nova.compute.claims [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Claim successful on node user
Nov 16 15:30:22 user nova-compute[74658]: INFO nova.compute.resource_tracker [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating resource usage from migration 47fe44cb-3725-4a35-a2ba-ff5ef332a9c7
Nov 16 15:30:22 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:30:22 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:30:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.390s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:22 user nova-compute[74658]: INFO nova.compute.manager [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Migrating
Nov 16 15:30:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-8593ba2e-9951-4fdd-b84b-797b24c92567 req-603d16bd-391f-430b-89d5-bd86c27bd5d7 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-changed-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-8593ba2e-9951-4fdd-b84b-797b24c92567 req-603d16bd-391f-430b-89d5-bd86c27bd5d7 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Refreshing instance network info cache due to event network-changed-d530bb58-eab8-4783-b16b-b1ec126da39f. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:30:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8593ba2e-9951-4fdd-b84b-797b24c92567 req-603d16bd-391f-430b-89d5-bd86c27bd5d7 service nova] Acquiring lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:30:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8593ba2e-9951-4fdd-b84b-797b24c92567 req-603d16bd-391f-430b-89d5-bd86c27bd5d7 service nova] Acquired lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:30:22 user nova-compute[74658]: DEBUG nova.network.neutron [req-8593ba2e-9951-4fdd-b84b-797b24c92567 req-603d16bd-391f-430b-89d5-bd86c27bd5d7 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Refreshing network info cache for port d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:30:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:30:23 user nova-compute[74658]: DEBUG nova.network.neutron [req-8593ba2e-9951-4fdd-b84b-797b24c92567 req-603d16bd-391f-430b-89d5-bd86c27bd5d7 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updated VIF entry in instance network info cache for port d530bb58-eab8-4783-b16b-b1ec126da39f. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:30:23 user nova-compute[74658]: DEBUG nova.network.neutron [req-8593ba2e-9951-4fdd-b84b-797b24c92567 req-603d16bd-391f-430b-89d5-bd86c27bd5d7 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating instance_info_cache with network_info: [{"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:30:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8593ba2e-9951-4fdd-b84b-797b24c92567 req-603d16bd-391f-430b-89d5-bd86c27bd5d7 service nova] Releasing lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:30:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquired lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:30:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:30:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating instance_info_cache with network_info: [{"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:30:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Releasing lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:30:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Starting migrate_disk_and_power_off {{(pid=74658) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 15:30:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG nova.compute.manager [req-cf6f20a0-fdf3-4987-98f1-146ed2a6c545 req-819409b7-a0fc-4c25-9581-d6d772682267 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-vif-unplugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cf6f20a0-fdf3-4987-98f1-146ed2a6c545 req-819409b7-a0fc-4c25-9581-d6d772682267 service nova] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cf6f20a0-fdf3-4987-98f1-146ed2a6c545 req-819409b7-a0fc-4c25-9581-d6d772682267 service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cf6f20a0-fdf3-4987-98f1-146ed2a6c545 req-819409b7-a0fc-4c25-9581-d6d772682267 service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG nova.compute.manager [req-cf6f20a0-fdf3-4987-98f1-146ed2a6c545 req-819409b7-a0fc-4c25-9581-d6d772682267 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] No waiting events found dispatching network-vif-unplugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:24 user nova-compute[74658]: WARNING nova.compute.manager [req-cf6f20a0-fdf3-4987-98f1-146ed2a6c545 req-819409b7-a0fc-4c25-9581-d6d772682267 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received unexpected event network-vif-unplugged-d530bb58-eab8-4783-b16b-b1ec126da39f for instance with vm_state active and task_state resize_migrating.
Nov 16 15:30:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:24 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Instance destroyed successfully.
Nov 16 15:30:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-966150362',display_name='tempest-ServerActionsTestOtherA-server-966150362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-966150362',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfs3x9tKyy9KHJUedCxh49P9LH14YRsacTcDaxEVd8YqO4Cuyb8pJja3XT1OhFAuM946OKuatB2JwDtDIzcfi6ebK97F+SRlzAxuSg9qPWnSDGTyfFCtkcgNG6s/nMQMw==',key_name='tempest-keypair-1686675082',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:28:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-bmp0xx53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=67d2aeee-7218-4e85-baa3-157643a4301e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2038464173-network", "vif_mac": "fa:16:3e:26:89:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2038464173-network", "vif_mac": "fa:16:3e:26:89:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_vif [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd530bb58-ea, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=532c6846-2e2e-4f7b-b7a9-94e677d10878) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:24 user nova-compute[74658]: INFO os_vif [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea')
Nov 16 15:30:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucsVCmpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:30:24 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[998f450f-f93c-4795-9f50-71a8933feb50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:30:24 user nova-compute[74658]: No targets found.
Nov 16 15:30:24 user nova-compute[74658]: iSNS:
Nov 16 15:30:24 user nova-compute[74658]: No targets found.
Nov 16 15:30:24 user nova-compute[74658]: STATIC:
Nov 16 15:30:24 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b
Nov 16 15:30:24 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:30:24 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:30:24 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11
Nov 16 15:30:24 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:30:24 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:30:24 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a
Nov 16 15:30:24 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:30:24 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:30:24 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44
Nov 16 15:30:24 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:30:24 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:30:24 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7
Nov 16 15:30:24 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:30:24 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:30:24 user nova-compute[74658]: FIRMWARE:
Nov 16 15:30:24 user nova-compute[74658]: No targets found.
Nov 16 15:30:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:30:24 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:30:24 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a488a94d-ecfb-406f-9df6-55b1ac9073e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[762245db-2de9-4fb2-998d-415106747e34]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:24 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:24 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:24 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:24 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:24 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:24 user nova-compute[74658]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:24 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:24 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0733db7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a'): ({'sdf'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Removing single pathed devices sdf {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[786301a2-4b2a-4451-b296-7048c6b9fe95]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f7d146-b6ab-4212-a812-02c716d2dde0]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flushing IO for device /dev/sdf {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6963176-3b8d-40c7-972f-a276adfca753]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[af12d580-1935-4c53-a6e5-f7688645d875]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] SCSI volumes sdf have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOec91cc34-9e73f273ce49e43e', '/dev/disk/by-id/scsi-23965373366323733', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ec91cc34') {{(pid=84815) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 15:30:24 user nova-compute[74658]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOec91cc34-9e73f273ce49e43e
Nov 16 15:30:24 user nova-compute[74658]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23965373366323733
Nov 16 15:30:24 user nova-compute[74658]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ec91cc34
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[582f1bc7-6512-45a1-82be-5b7fdc3ad7eb]: (4, None) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2235b5-6587-4ff9-b0b2-f93813f5edb8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed33e25e-4951-45c2-ba71-1fd7872aa383]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260]
Nov 16 15:30:24 user nova-compute[74658]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260] successful.
Nov 16 15:30:24 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83bb7ab-15a9-49bf-b0e0-558069708429]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== disconnect_volume: return (345ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:30:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:30:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:25 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Port d530bb58-eab8-4783-b16b-b1ec126da39f binding to destination host user is already ACTIVE {{(pid=74658) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-ad352cd5-f011-4d2e-b6d1-3e9963803d61 req-23afafab-072f-438f-95d3-eaad4b7622bd service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ad352cd5-f011-4d2e-b6d1-3e9963803d61 req-23afafab-072f-438f-95d3-eaad4b7622bd service nova] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ad352cd5-f011-4d2e-b6d1-3e9963803d61 req-23afafab-072f-438f-95d3-eaad4b7622bd service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ad352cd5-f011-4d2e-b6d1-3e9963803d61 req-23afafab-072f-438f-95d3-eaad4b7622bd service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-ad352cd5-f011-4d2e-b6d1-3e9963803d61 req-23afafab-072f-438f-95d3-eaad4b7622bd service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] No waiting events found dispatching network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:26 user nova-compute[74658]: WARNING nova.compute.manager [req-ad352cd5-f011-4d2e-b6d1-3e9963803d61 req-23afafab-072f-438f-95d3-eaad4b7622bd service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received unexpected event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f for instance with vm_state active and task_state resize_migrated.
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquired lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating instance_info_cache with network_info: [{"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Releasing lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG os_brick.utils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d887f528-dd4f-4048-9bdb-2dd96e991199]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d20df-b3ee-409c-a1d9-71e0eeb88d85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1239e144-e467-436a-8353-83707843a740]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5963a8-3589-4e30-a95d-2ef765c46da9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:30:26 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:30:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[af50643e-5fb5-4f7d-906a-ee2c870a8825]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:30:26 user nova-compute[74658]: DEBUG os_brick.utils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:30:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Starting finish_migration {{(pid=74658) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Instance directory exists: not creating {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 15:30:31 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Creating image(s)
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Ensure instance console log exists: /opt/stack/data/nova/instances/67d2aeee-7218-4e85-baa3-157643a4301e/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Start _get_guest_xml network_info=[{"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2038464173-network", "vif_mac": "fa:16:3e:26:89:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8e44af45-0fdc-4fad-ba9e-fdbe68eca89d', 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucsVCmpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '67d2aeee-7218-4e85-baa3-157643a4301e', 'attached_at': '2023-11-16T15:30:32.000000', 'detached_at': '', 'volume_id': 'ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 'serial': 'ce1d3c13-65f3-4338-91c5-5ee6dbc0392a'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:30:31 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:30:31 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucsVCmpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:30:31 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:30:31 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:30:31 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3b6756-6186-4a72-82d8-b8a62d74d7f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:30:31 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc19e7a1-f9f2-47dd-904c-44955af0a188]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a] added
Nov 16 15:30:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[917e2b24-02c3-4243-99f2-2d61df35c4e2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b1bcfa-1029-43a6-95f8-03ca7f421916]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucsVCmpR {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucsVCmpR" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[981052ff-ac96-4e42-b490-3c27b1427428]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ucsVCmpR'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[52460ef6-ec92-4e15-a0e8-7e0fe71803be]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eee14f9-51fc-4ef7-9d02-2641e7c372b6]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97a51e5-67be-42da-9f1e-ee8f529384ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260]
Nov 16 15:30:31 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260] successful.
Nov 16 15:30:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3768315b-9655-46ba-bc3d-87931f3f2546]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba75558c-6a5c-4c90-9de3-2f8ab8869baf]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:30:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:31 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:30:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:30:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:30:32 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:30:32 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:30:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[44da27e7-8800-492e-84a5-3785a5ab9091]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:32 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucsVCmpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23965373366323733', 'path': '/dev/sdf'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965373366323733', 'path': '/dev/sdf'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-966150362',display_name='tempest-ServerActionsTestOtherA-server-966150362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-966150362',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfs3x9tKyy9KHJUedCxh49P9LH14YRsacTcDaxEVd8YqO4Cuyb8pJja3XT1OhFAuM946OKuatB2JwDtDIzcfi6ebK97F+SRlzAxuSg9qPWnSDGTyfFCtkcgNG6s/nMQMw==',key_name='tempest-keypair-1686675082',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:28:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-bmp0xx53',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=67d2aeee-7218-4e85-baa3-157643a4301e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2038464173-network", "vif_mac": "fa:16:3e:26:89:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2038464173-network", "vif_mac": "fa:16:3e:26:89:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:30:33 user nova-compute[74658]:   <uuid>67d2aeee-7218-4e85-baa3-157643a4301e</uuid>
Nov 16 15:30:33 user nova-compute[74658]:   <name>instance-0000001d</name>
Nov 16 15:30:33 user nova-compute[74658]:   <memory>2097152</memory>
Nov 16 15:30:33 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:30:33 user nova-compute[74658]:   <metadata>
Nov 16 15:30:33 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:30:33 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:30:33 user nova-compute[74658]:       <nova:name>tempest-ServerActionsTestOtherA-server-966150362</nova:name>
Nov 16 15:30:33 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:30:31</nova:creationTime>
Nov 16 15:30:33 user nova-compute[74658]:       <nova:flavor name="m1.small">
Nov 16 15:30:33 user nova-compute[74658]:         <nova:memory>2048</nova:memory>
Nov 16 15:30:33 user nova-compute[74658]:         <nova:disk>20</nova:disk>
Nov 16 15:30:33 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:30:33 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:30:33 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:30:33 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:30:33 user nova-compute[74658]:       <nova:owner>
Nov 16 15:30:33 user nova-compute[74658]:         <nova:user uuid="d8507e72d5b248cd8a6a8b9bea6733cb">tempest-ServerActionsTestOtherA-1362925052-project-member</nova:user>
Nov 16 15:30:33 user nova-compute[74658]:         <nova:project uuid="6b189fdeea224d4dbdc2923041dc8e75">tempest-ServerActionsTestOtherA-1362925052</nova:project>
Nov 16 15:30:33 user nova-compute[74658]:       </nova:owner>
Nov 16 15:30:33 user nova-compute[74658]:       <nova:ports>
Nov 16 15:30:33 user nova-compute[74658]:         <nova:port uuid="d530bb58-eab8-4783-b16b-b1ec126da39f">
Nov 16 15:30:33 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 15:30:33 user nova-compute[74658]:         </nova:port>
Nov 16 15:30:33 user nova-compute[74658]:       </nova:ports>
Nov 16 15:30:33 user nova-compute[74658]:     </nova:instance>
Nov 16 15:30:33 user nova-compute[74658]:   </metadata>
Nov 16 15:30:33 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:30:33 user nova-compute[74658]:     <system>
Nov 16 15:30:33 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:30:33 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:30:33 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:30:33 user nova-compute[74658]:       <entry name="serial">67d2aeee-7218-4e85-baa3-157643a4301e</entry>
Nov 16 15:30:33 user nova-compute[74658]:       <entry name="uuid">67d2aeee-7218-4e85-baa3-157643a4301e</entry>
Nov 16 15:30:33 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:30:33 user nova-compute[74658]:     </system>
Nov 16 15:30:33 user nova-compute[74658]:   </sysinfo>
Nov 16 15:30:33 user nova-compute[74658]:   <os>
Nov 16 15:30:33 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:30:33 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:30:33 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:30:33 user nova-compute[74658]:   </os>
Nov 16 15:30:33 user nova-compute[74658]:   <features>
Nov 16 15:30:33 user nova-compute[74658]:     <acpi/>
Nov 16 15:30:33 user nova-compute[74658]:     <apic/>
Nov 16 15:30:33 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:30:33 user nova-compute[74658]:   </features>
Nov 16 15:30:33 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:30:33 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:30:33 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:30:33 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:30:33 user nova-compute[74658]:   </clock>
Nov 16 15:30:33 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:30:33 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:30:33 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:30:33 user nova-compute[74658]:   </cpu>
Nov 16 15:30:33 user nova-compute[74658]:   <devices>
Nov 16 15:30:33 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:30:33 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:30:33 user nova-compute[74658]:       <source dev="/dev/sdf"/>
Nov 16 15:30:33 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:30:33 user nova-compute[74658]:       <serial>ce1d3c13-65f3-4338-91c5-5ee6dbc0392a</serial>
Nov 16 15:30:33 user nova-compute[74658]:     </disk>
Nov 16 15:30:33 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:30:33 user nova-compute[74658]:       <mac address="fa:16:3e:26:89:6f"/>
Nov 16 15:30:33 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:30:33 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:30:33 user nova-compute[74658]:       <target dev="tapd530bb58-ea"/>
Nov 16 15:30:33 user nova-compute[74658]:     </interface>
Nov 16 15:30:33 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:30:33 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/67d2aeee-7218-4e85-baa3-157643a4301e/console.log" append="off"/>
Nov 16 15:30:33 user nova-compute[74658]:     </serial>
Nov 16 15:30:33 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:30:33 user nova-compute[74658]:     <video>
Nov 16 15:30:33 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:30:33 user nova-compute[74658]:     </video>
Nov 16 15:30:33 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:30:33 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:30:33 user nova-compute[74658]:     </rng>
Nov 16 15:30:33 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:30:33 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:30:33 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:30:33 user nova-compute[74658]:     </memballoon>
Nov 16 15:30:33 user nova-compute[74658]:   </devices>
Nov 16 15:30:33 user nova-compute[74658]: </domain>
Nov 16 15:30:33 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-966150362',display_name='tempest-ServerActionsTestOtherA-server-966150362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-966150362',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfs3x9tKyy9KHJUedCxh49P9LH14YRsacTcDaxEVd8YqO4Cuyb8pJja3XT1OhFAuM946OKuatB2JwDtDIzcfi6ebK97F+SRlzAxuSg9qPWnSDGTyfFCtkcgNG6s/nMQMw==',key_name='tempest-keypair-1686675082',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:28:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-bmp0xx53',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=67d2aeee-7218-4e85-baa3-157643a4301e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2038464173-network", "vif_mac": "fa:16:3e:26:89:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2038464173-network", "vif_mac": "fa:16:3e:26:89:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG os_vif [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71621cfc-3451-5aaf-830c-86427ce76a34', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd530bb58-ea, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd530bb58-ea, col_values=(('qos', UUID('207b0b71-beba-4fc8-8e5a-9490e8956298')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd530bb58-ea, col_values=(('external_ids', {'iface-id': 'd530bb58-eab8-4783-b16b-b1ec126da39f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:89:6f', 'vm-uuid': '67d2aeee-7218-4e85-baa3-157643a4301e'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:33 user nova-compute[74658]: INFO os_vif [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea')
Nov 16 15:30:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:30:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] No VIF found with MAC fa:16:3e:26:89:6f, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:30:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:34 user nova-compute[74658]: DEBUG nova.compute.manager [req-15c693cd-8bd7-4ce0-b477-0029b9c2016f req-6b1635fd-1bce-4941-9f0c-9203d2430beb service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-15c693cd-8bd7-4ce0-b477-0029b9c2016f req-6b1635fd-1bce-4941-9f0c-9203d2430beb service nova] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-15c693cd-8bd7-4ce0-b477-0029b9c2016f req-6b1635fd-1bce-4941-9f0c-9203d2430beb service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-15c693cd-8bd7-4ce0-b477-0029b9c2016f req-6b1635fd-1bce-4941-9f0c-9203d2430beb service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:34 user nova-compute[74658]: DEBUG nova.compute.manager [req-15c693cd-8bd7-4ce0-b477-0029b9c2016f req-6b1635fd-1bce-4941-9f0c-9203d2430beb service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] No waiting events found dispatching network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:34 user nova-compute[74658]: WARNING nova.compute.manager [req-15c693cd-8bd7-4ce0-b477-0029b9c2016f req-6b1635fd-1bce-4941-9f0c-9203d2430beb service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received unexpected event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f for instance with vm_state active and task_state resize_finish.
Nov 16 15:30:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:36 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:30:36 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Instance running successfully.
Nov 16 15:30:36 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Failed to set time: agent not configured {{(pid=74658) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 15:30:36 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d885ef8b-4524-4923-8459-21fbe66d1c60 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] finish_migration finished successfully. {{(pid=74658) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 15:30:36 user nova-compute[74658]: DEBUG nova.compute.manager [req-c32fb8bc-85d2-44ab-acdd-3a51ac964bec req-5ce7bf81-4196-4f81-91ec-fdd4c55dea23 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c32fb8bc-85d2-44ab-acdd-3a51ac964bec req-5ce7bf81-4196-4f81-91ec-fdd4c55dea23 service nova] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c32fb8bc-85d2-44ab-acdd-3a51ac964bec req-5ce7bf81-4196-4f81-91ec-fdd4c55dea23 service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c32fb8bc-85d2-44ab-acdd-3a51ac964bec req-5ce7bf81-4196-4f81-91ec-fdd4c55dea23 service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:36 user nova-compute[74658]: DEBUG nova.compute.manager [req-c32fb8bc-85d2-44ab-acdd-3a51ac964bec req-5ce7bf81-4196-4f81-91ec-fdd4c55dea23 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] No waiting events found dispatching network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:36 user nova-compute[74658]: WARNING nova.compute.manager [req-c32fb8bc-85d2-44ab-acdd-3a51ac964bec req-5ce7bf81-4196-4f81-91ec-fdd4c55dea23 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received unexpected event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f for instance with vm_state resized and task_state None.
Nov 16 15:30:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:40 user nova-compute[74658]: INFO nova.compute.manager [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Unshelving
Nov 16 15:30:40 user nova-compute[74658]: INFO nova.virt.block_device [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Booting with volume aca4bb17-9e64-4e65-821d-27a1cf4a77f0 at /dev/vdc
Nov 16 15:30:40 user nova-compute[74658]: DEBUG os_brick.utils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[11484b7d-9a82-410c-bc30-225edf123857]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a156df44-be93-4059-b8c6-4bf4b90281e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[944e955a-ffdd-49a1-a078-f9f7e128c501]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[993432ef-9f53-43b5-95f0-1cef19b7cb99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:30:40 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:30:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb397682-4ad0-4573-a78d-411fb60e8bcb]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG os_brick.utils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:30:40 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updating existing volume attachment record: b82387a6-4419-45a4-b96b-684659fa9494 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:30:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'pci_requests' on Instance uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'numa_topology' on Instance uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:30:45 user nova-compute[74658]: INFO nova.compute.claims [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Claim successful on node user
Nov 16 15:30:45 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:30:45 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:30:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:45 user nova-compute[74658]: INFO nova.network.neutron [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updating port 1aaa65c9-53cf-439c-89b1-90afbc230119 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 15:30:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:30:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquired lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:30:46 user nova-compute[74658]: DEBUG nova.network.neutron [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:30:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-e8f4a3f4-bc44-486b-b77f-44d83a233203 req-b833fc36-8e7d-4acd-ab38-df3054b2f31a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-changed-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-e8f4a3f4-bc44-486b-b77f-44d83a233203 req-b833fc36-8e7d-4acd-ab38-df3054b2f31a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Refreshing instance network info cache due to event network-changed-1aaa65c9-53cf-439c-89b1-90afbc230119. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:30:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e8f4a3f4-bc44-486b-b77f-44d83a233203 req-b833fc36-8e7d-4acd-ab38-df3054b2f31a service nova] Acquiring lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:30:47 user nova-compute[74658]: DEBUG nova.network.neutron [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updating instance_info_cache with network_info: [{"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:30:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Releasing lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:30:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:30:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Creating image(s)
Nov 16 15:30:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "/opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "/opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "/opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:47 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'trusted_certs' on Instance uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e8f4a3f4-bc44-486b-b77f-44d83a233203 req-b833fc36-8e7d-4acd-ab38-df3054b2f31a service nova] Acquired lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:30:47 user nova-compute[74658]: DEBUG nova.network.neutron [req-e8f4a3f4-bc44-486b-b77f-44d83a233203 req-b833fc36-8e7d-4acd-ab38-df3054b2f31a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Refreshing network info cache for port 1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:30:47 user nova-compute[74658]: DEBUG nova.objects.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Object Instance<f314ad85-524a-4326-bdd5-2c7c4de78690> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:30:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "34afd04a9395ddcc06deb67b312181602effe9ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "34afd04a9395ddcc06deb67b312181602effe9ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab.part --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:48 user nova-compute[74658]: INFO nova.compute.manager [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Detaching volume 7e403a0a-3fdc-495b-a0fb-5f05422f3ea7
Nov 16 15:30:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG nova.virt.images [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] e94e4679-797f-4bcb-9a0d-3b58bb3c0f25 was qcow2, converting to raw {{(pid=74658) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab.part /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab.converted {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:48 user nova-compute[74658]: INFO nova.virt.block_device [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Attempting to driver detach volume 7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 from mountpoint /dev/vdb
Nov 16 15:30:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Attempting to detach device vdb from instance 6c8dd806-c294-40dd-a13d-63659a1d5669 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:30:48 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:30:48 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:30:48 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:30:48 user nova-compute[74658]:   <serial>7e403a0a-3fdc-495b-a0fb-5f05422f3ea7</serial>
Nov 16 15:30:48 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 15:30:48 user nova-compute[74658]: </disk>
Nov 16 15:30:48 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:30:48 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully detached device vdb from instance 6c8dd806-c294-40dd-a13d-63659a1d5669 from the persistent domain config.
Nov 16 15:30:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c8dd806-c294-40dd-a13d-63659a1d5669 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:30:48 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:30:48 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:30:48 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:30:48 user nova-compute[74658]:   <serial>7e403a0a-3fdc-495b-a0fb-5f05422f3ea7</serial>
Nov 16 15:30:48 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 15:30:48 user nova-compute[74658]: </disk>
Nov 16 15:30:48 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG nova.network.neutron [req-e8f4a3f4-bc44-486b-b77f-44d83a233203 req-b833fc36-8e7d-4acd-ab38-df3054b2f31a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updated VIF entry in instance network info cache for port 1aaa65c9-53cf-439c-89b1-90afbc230119. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG nova.network.neutron [req-e8f4a3f4-bc44-486b-b77f-44d83a233203 req-b833fc36-8e7d-4acd-ab38-df3054b2f31a service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updating instance_info_cache with network_info: [{"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:30:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e8f4a3f4-bc44-486b-b77f-44d83a233203 req-b833fc36-8e7d-4acd-ab38-df3054b2f31a service nova] Releasing lock "refresh_cache-f314ad85-524a-4326-bdd5-2c7c4de78690" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab.part /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab.converted" returned: 0 in 0.441s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab.converted --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "34afd04a9395ddcc06deb67b312181602effe9ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.100s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "34afd04a9395ddcc06deb67b312181602effe9ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "34afd04a9395ddcc06deb67b312181602effe9ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab,backing_fmt=raw /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab,backing_fmt=raw /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk 1073741824" returned: 0 in 0.047s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "34afd04a9395ddcc06deb67b312181602effe9ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'migration_context' on Instance uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:49 user nova-compute[74658]: DEBUG nova.objects.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Object Instance<f314ad85-524a-4326-bdd5-2c7c4de78690> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:30:49 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Rebasing disk image.
Nov 16 15:30:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 -F raw /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 -F raw /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk" returned: 0 in 2.821s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Ensure instance console log exists: /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Start _get_guest_xml network_info=[{"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='97ec4ead1ee44e2cc343d7bc49be4eb9',container_format='bare',created_at=2023-11-16T15:28:48Z,direct_url=<?>,disk_format='qcow2',id=e94e4679-797f-4bcb-9a0d-3b58bb3c0f25,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-909763891-shelved',owner='8e355315b27543ccacf00b9461cff1a0',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T15:28:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b82387a6-4419-45a4-b96b-684659fa9494', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtdmlQYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f314ad85-524a-4326-bdd5-2c7c4de78690', 'attached_at': '', 'detached_at': '', 'volume_id': 'aca4bb17-9e64-4e65-821d-27a1cf4a77f0', 'serial': 'aca4bb17-9e64-4e65-821d-27a1cf4a77f0'}, 'boot_index': None, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:30:52 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:30:52 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='97ec4ead1ee44e2cc343d7bc49be4eb9',container_format='bare',created_at=2023-11-16T15:28:48Z,direct_url=<?>,disk_format='qcow2',id=e94e4679-797f-4bcb-9a0d-3b58bb3c0f25,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-909763891-shelved',owner='8e355315b27543ccacf00b9461cff1a0',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T15:28:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'vcpu_model' on Instance uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.objects.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Object Instance<f314ad85-524a-4326-bdd5-2c7c4de78690> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtdmlQYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:30:52 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:30:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:30:52 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:30:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:30:52 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:30:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260" returned: 21 in 0.061s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1cc38f-c663-48b1-a2b6-cec342790a26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:30:52 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7317e8-1caa-4af9-9c49-719afd2c63c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0] added
Nov 16 15:30:53 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ce8316-8994-4b8e-ac4b-4824cedbb72e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac534c2-bf98-405a-a4dc-c5a11a479cc4]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtdmlQYn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtdmlQYn" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c15efd-9746-4340-b750-be7fe81416fe]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jtdmlQYn'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa46f2dd-bf5d-4a25-814b-be40899730f1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f0a26a-4f6b-44a7-af0d-07a3df35dcd8]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:53 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:53 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f236d1e6-d3e8-4091-8c3c-19f77573bf13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0, portal: 172.16.0.220,3260]
Nov 16 15:30:53 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0, portal: 172.16.0.220,3260] successful.
Nov 16 15:30:53 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0de7a0-1b36-406b-915c-f548ef970072]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3cc53b-c5a2-43b4-b5fd-3e653b30a5a6]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:30:53 user nova-compute[74658]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)
Nov 16 15:30:53 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b6a16e-8330-4886-bb67-a4198a436403]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtdmlQYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:30:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23666373733396237', 'path': '/dev/sdg'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666373733396237', 'path': '/dev/sdg'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-909763891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-909763891',id=26,image_ref='e94e4679-797f-4bcb-9a0d-3b58bb3c0f25',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-876002203',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:26:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-m5jl5mv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member',shelved_at='2023-11-16T15:28:52.457807',shelved_host='user',shelved_image_id='e94e4679-797f-4bcb-9a0d-3b58bb3c0f25'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=f314ad85-524a-4326-bdd5-2c7c4de78690,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'pci_devices' on Instance uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.objects.base [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Object Instance<f314ad85-524a-4326-bdd5-2c7c4de78690> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:30:54 user nova-compute[74658]:   <uuid>f314ad85-524a-4326-bdd5-2c7c4de78690</uuid>
Nov 16 15:30:54 user nova-compute[74658]:   <name>instance-0000001a</name>
Nov 16 15:30:54 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:30:54 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:30:54 user nova-compute[74658]:   <metadata>
Nov 16 15:30:54 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:30:54 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:30:54 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-909763891</nova:name>
Nov 16 15:30:54 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:30:52</nova:creationTime>
Nov 16 15:30:54 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:30:54 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:30:54 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:30:54 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:30:54 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:30:54 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:30:54 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:30:54 user nova-compute[74658]:       <nova:owner>
Nov 16 15:30:54 user nova-compute[74658]:         <nova:user uuid="78e64660311e44e8aec0701ea52c2bb6">tempest-AttachVolumeShelveTestJSON-1521088540-project-member</nova:user>
Nov 16 15:30:54 user nova-compute[74658]:         <nova:project uuid="8e355315b27543ccacf00b9461cff1a0">tempest-AttachVolumeShelveTestJSON-1521088540</nova:project>
Nov 16 15:30:54 user nova-compute[74658]:       </nova:owner>
Nov 16 15:30:54 user nova-compute[74658]:       <nova:root type="image" uuid="e94e4679-797f-4bcb-9a0d-3b58bb3c0f25"/>
Nov 16 15:30:54 user nova-compute[74658]:       <nova:ports>
Nov 16 15:30:54 user nova-compute[74658]:         <nova:port uuid="1aaa65c9-53cf-439c-89b1-90afbc230119">
Nov 16 15:30:54 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 15:30:54 user nova-compute[74658]:         </nova:port>
Nov 16 15:30:54 user nova-compute[74658]:       </nova:ports>
Nov 16 15:30:54 user nova-compute[74658]:     </nova:instance>
Nov 16 15:30:54 user nova-compute[74658]:   </metadata>
Nov 16 15:30:54 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:30:54 user nova-compute[74658]:     <system>
Nov 16 15:30:54 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:30:54 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:30:54 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:30:54 user nova-compute[74658]:       <entry name="serial">f314ad85-524a-4326-bdd5-2c7c4de78690</entry>
Nov 16 15:30:54 user nova-compute[74658]:       <entry name="uuid">f314ad85-524a-4326-bdd5-2c7c4de78690</entry>
Nov 16 15:30:54 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:30:54 user nova-compute[74658]:     </system>
Nov 16 15:30:54 user nova-compute[74658]:   </sysinfo>
Nov 16 15:30:54 user nova-compute[74658]:   <os>
Nov 16 15:30:54 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:30:54 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:30:54 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:30:54 user nova-compute[74658]:   </os>
Nov 16 15:30:54 user nova-compute[74658]:   <features>
Nov 16 15:30:54 user nova-compute[74658]:     <acpi/>
Nov 16 15:30:54 user nova-compute[74658]:     <apic/>
Nov 16 15:30:54 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:30:54 user nova-compute[74658]:   </features>
Nov 16 15:30:54 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:30:54 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:30:54 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:30:54 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:30:54 user nova-compute[74658]:   </clock>
Nov 16 15:30:54 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:30:54 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:30:54 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:30:54 user nova-compute[74658]:   </cpu>
Nov 16 15:30:54 user nova-compute[74658]:   <devices>
Nov 16 15:30:54 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:30:54 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:30:54 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk"/>
Nov 16 15:30:54 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:30:54 user nova-compute[74658]:     </disk>
Nov 16 15:30:54 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:30:54 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:30:54 user nova-compute[74658]:       <source dev="/dev/sdg"/>
Nov 16 15:30:54 user nova-compute[74658]:       <target dev="vdc" bus="virtio"/>
Nov 16 15:30:54 user nova-compute[74658]:       <serial>aca4bb17-9e64-4e65-821d-27a1cf4a77f0</serial>
Nov 16 15:30:54 user nova-compute[74658]:     </disk>
Nov 16 15:30:54 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:30:54 user nova-compute[74658]:       <mac address="fa:16:3e:48:6b:ed"/>
Nov 16 15:30:54 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:30:54 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:30:54 user nova-compute[74658]:       <target dev="tap1aaa65c9-53"/>
Nov 16 15:30:54 user nova-compute[74658]:     </interface>
Nov 16 15:30:54 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:30:54 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/console.log" append="off"/>
Nov 16 15:30:54 user nova-compute[74658]:     </serial>
Nov 16 15:30:54 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:30:54 user nova-compute[74658]:     <video>
Nov 16 15:30:54 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:30:54 user nova-compute[74658]:     </video>
Nov 16 15:30:54 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:30:54 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:30:54 user nova-compute[74658]:     </rng>
Nov 16 15:30:54 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:30:54 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:30:54 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:30:54 user nova-compute[74658]:     </memballoon>
Nov 16 15:30:54 user nova-compute[74658]:   </devices>
Nov 16 15:30:54 user nova-compute[74658]: </domain>
Nov 16 15:30:54 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-909763891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-909763891',id=26,image_ref='e94e4679-797f-4bcb-9a0d-3b58bb3c0f25',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-876002203',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:26:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-m5jl5mv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member',shelved_at='2023-11-16T15:28:52.457807',shelved_host='user',shelved_image_id='e94e4679-797f-4bcb-9a0d-3b58bb3c0f25'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=f314ad85-524a-4326-bdd5-2c7c4de78690,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG os_vif [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32824065-8eaf-5e0d-bec8-f8559b227ac4', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aaa65c9-53, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aaa65c9-53, col_values=(('qos', UUID('66da7025-f803-4304-b716-2ba283ee6e61')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aaa65c9-53, col_values=(('external_ids', {'iface-id': '1aaa65c9-53cf-439c-89b1-90afbc230119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:6b:ed', 'vm-uuid': 'f314ad85-524a-4326-bdd5-2c7c4de78690'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:54 user nova-compute[74658]: INFO os_vif [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53')
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:30:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] No VIF found with MAC fa:16:3e:48:6b:ed, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:30:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-28387012-f83b-4d1e-8b09-2a3ccc17ff95 req-0e414378-3334-48ef-8473-bd0b05f452d6 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28387012-f83b-4d1e-8b09-2a3ccc17ff95 req-0e414378-3334-48ef-8473-bd0b05f452d6 service nova] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28387012-f83b-4d1e-8b09-2a3ccc17ff95 req-0e414378-3334-48ef-8473-bd0b05f452d6 service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28387012-f83b-4d1e-8b09-2a3ccc17ff95 req-0e414378-3334-48ef-8473-bd0b05f452d6 service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-28387012-f83b-4d1e-8b09-2a3ccc17ff95 req-0e414378-3334-48ef-8473-bd0b05f452d6 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] No waiting events found dispatching network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:56 user nova-compute[74658]: WARNING nova.compute.manager [req-28387012-f83b-4d1e-8b09-2a3ccc17ff95 req-0e414378-3334-48ef-8473-bd0b05f452d6 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received unexpected event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 15:30:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:30:58 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:30:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:30:58 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Instance spawned successfully.
Nov 16 15:30:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-48f3ce51-4431-4dc1-81aa-7b72262011e3 req-502eb7fe-1b43-4282-88b2-c4b544b86800 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:30:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-48f3ce51-4431-4dc1-81aa-7b72262011e3 req-502eb7fe-1b43-4282-88b2-c4b544b86800 service nova] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:30:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-48f3ce51-4431-4dc1-81aa-7b72262011e3 req-502eb7fe-1b43-4282-88b2-c4b544b86800 service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:30:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-48f3ce51-4431-4dc1-81aa-7b72262011e3 req-502eb7fe-1b43-4282-88b2-c4b544b86800 service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-48f3ce51-4431-4dc1-81aa-7b72262011e3 req-502eb7fe-1b43-4282-88b2-c4b544b86800 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] No waiting events found dispatching network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:30:58 user nova-compute[74658]: WARNING nova.compute.manager [req-48f3ce51-4431-4dc1-81aa-7b72262011e3 req-502eb7fe-1b43-4282-88b2-c4b544b86800 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received unexpected event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 15:30:58 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:30:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ff92ad4e-e74a-419e-b14c-ca2eb412bd18 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.416s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:30:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:31:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:31:02 user nova-compute[74658]: INFO nova.compute.claims [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Claim successful on node user
Nov 16 15:31:02 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:31:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:31:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:31:02 user nova-compute[74658]: DEBUG nova.policy [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3cee7d0742148a1808713d978dbd01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08549dcd4d26408098316f61ca4a6ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:31:03 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Creating image(s)
Nov 16 15:31:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "/opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "/opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1.part --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Successfully created port: 8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1.part --force-share --output=json" returned: 0 in 0.366s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG nova.virt.images [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] 098e0374-5ed5-4205-a769-10246231155b was qcow2, converting to raw {{(pid=74658) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1.part /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1.converted {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1.part /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1.converted" returned: 0 in 0.167s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1.converted --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Successfully updated port: 8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.152s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquired lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-3b5b59d3-f369-4f35-b436-ba686187caaf req-9b64ac77-41a7-45cb-b4c0-eab9cbc0c0e5 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-changed-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-3b5b59d3-f369-4f35-b436-ba686187caaf req-9b64ac77-41a7-45cb-b4c0-eab9cbc0c0e5 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Refreshing instance network info cache due to event network-changed-8845dcec-73a4-4fbc-a835-88ced3593d56. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3b5b59d3-f369-4f35-b436-ba686187caaf req-9b64ac77-41a7-45cb-b4c0-eab9cbc0c0e5 service nova] Acquiring lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1 --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1 --force-share --output=json" returned: 0 in 0.200s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1,backing_fmt=raw /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updating instance_info_cache with network_info: [{"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1,backing_fmt=raw /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk 1073741824" returned: 0 in 0.054s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Releasing lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Instance network_info: |[{"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3b5b59d3-f369-4f35-b436-ba686187caaf req-9b64ac77-41a7-45cb-b4c0-eab9cbc0c0e5 service nova] Acquired lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.network.neutron [req-3b5b59d3-f369-4f35-b436-ba686187caaf req-9b64ac77-41a7-45cb-b4c0-eab9cbc0c0e5 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Refreshing network info cache for port 8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1 --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updating instance_info_cache with network_info: [{"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Cannot resize image /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Ensure instance console log exists: /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Start _get_guest_xml network_info=[{"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:31:00Z,direct_url=<?>,disk_format='qcow2',id=098e0374-5ed5-4205-a769-10246231155b,min_disk=0,min_ram=0,name='tempest-scenario-img--2140840946',owner='08549dcd4d26408098316f61ca4a6ee2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:31:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': '098e0374-5ed5-4205-a769-10246231155b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:31:05 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:31:05 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:31:00Z,direct_url=<?>,disk_format='qcow2',id=098e0374-5ed5-4205-a769-10246231155b,min_disk=0,min_ram=0,name='tempest-scenario-img--2140840946',owner='08549dcd4d26408098316f61ca4a6ee2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:31:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-174035878',display_name='tempest-TestMinimumBasicScenario-server-174035878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-174035878',id=32,image_ref='098e0374-5ed5-4205-a769-10246231155b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBIKmwP0Z3hrk2u+0gQzlRnl15DqtD4JoLKfZeH2Yri7kluGPHjzvkxR33OpxHAO4/oNqUyhLh+7S9PevC2gOFslM/ehoL0M8iur8zX2pZwvXOjl+Ob1XoZwm/Ubsgc4w==',key_name='tempest-TestMinimumBasicScenario-1412037814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08549dcd4d26408098316f61ca4a6ee2',ramdisk_id='',reservation_id='r-bzp4qcu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='098e0374-5ed5-4205-a769-10246231155b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1910079629',owner_user_name='tempest-TestMinimumBasicScenario-1910079629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:31:03Z,user_data=None,user_id='d3cee7d0742148a1808713d978dbd01b',uuid=ecc12081-92a2-47e0-a885-efd13f9b5965,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converting VIF {"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:77:38,bridge_name='br-int',has_traffic_filtering=True,id=8845dcec-73a4-4fbc-a835-88ced3593d56,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dcec-73') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'pci_devices' on Instance uuid ecc12081-92a2-47e0-a885-efd13f9b5965 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:31:05 user nova-compute[74658]:   <uuid>ecc12081-92a2-47e0-a885-efd13f9b5965</uuid>
Nov 16 15:31:05 user nova-compute[74658]:   <name>instance-00000020</name>
Nov 16 15:31:05 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:31:05 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:31:05 user nova-compute[74658]:   <metadata>
Nov 16 15:31:05 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:31:05 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:31:05 user nova-compute[74658]:       <nova:name>tempest-TestMinimumBasicScenario-server-174035878</nova:name>
Nov 16 15:31:05 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:31:05</nova:creationTime>
Nov 16 15:31:05 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:31:05 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:31:05 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:31:05 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:31:05 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:31:05 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:31:05 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:31:05 user nova-compute[74658]:       <nova:owner>
Nov 16 15:31:05 user nova-compute[74658]:         <nova:user uuid="d3cee7d0742148a1808713d978dbd01b">tempest-TestMinimumBasicScenario-1910079629-project-member</nova:user>
Nov 16 15:31:05 user nova-compute[74658]:         <nova:project uuid="08549dcd4d26408098316f61ca4a6ee2">tempest-TestMinimumBasicScenario-1910079629</nova:project>
Nov 16 15:31:05 user nova-compute[74658]:       </nova:owner>
Nov 16 15:31:05 user nova-compute[74658]:       <nova:root type="image" uuid="098e0374-5ed5-4205-a769-10246231155b"/>
Nov 16 15:31:05 user nova-compute[74658]:       <nova:ports>
Nov 16 15:31:05 user nova-compute[74658]:         <nova:port uuid="8845dcec-73a4-4fbc-a835-88ced3593d56">
Nov 16 15:31:05 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 15:31:05 user nova-compute[74658]:         </nova:port>
Nov 16 15:31:05 user nova-compute[74658]:       </nova:ports>
Nov 16 15:31:05 user nova-compute[74658]:     </nova:instance>
Nov 16 15:31:05 user nova-compute[74658]:   </metadata>
Nov 16 15:31:05 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:31:05 user nova-compute[74658]:     <system>
Nov 16 15:31:05 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:31:05 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:31:05 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:31:05 user nova-compute[74658]:       <entry name="serial">ecc12081-92a2-47e0-a885-efd13f9b5965</entry>
Nov 16 15:31:05 user nova-compute[74658]:       <entry name="uuid">ecc12081-92a2-47e0-a885-efd13f9b5965</entry>
Nov 16 15:31:05 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:31:05 user nova-compute[74658]:     </system>
Nov 16 15:31:05 user nova-compute[74658]:   </sysinfo>
Nov 16 15:31:05 user nova-compute[74658]:   <os>
Nov 16 15:31:05 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:31:05 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:31:05 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:31:05 user nova-compute[74658]:   </os>
Nov 16 15:31:05 user nova-compute[74658]:   <features>
Nov 16 15:31:05 user nova-compute[74658]:     <acpi/>
Nov 16 15:31:05 user nova-compute[74658]:     <apic/>
Nov 16 15:31:05 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:31:05 user nova-compute[74658]:   </features>
Nov 16 15:31:05 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:31:05 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:31:05 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:31:05 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:31:05 user nova-compute[74658]:   </clock>
Nov 16 15:31:05 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:31:05 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:31:05 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:31:05 user nova-compute[74658]:   </cpu>
Nov 16 15:31:05 user nova-compute[74658]:   <devices>
Nov 16 15:31:05 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:31:05 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:31:05 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk"/>
Nov 16 15:31:05 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:31:05 user nova-compute[74658]:     </disk>
Nov 16 15:31:05 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:31:05 user nova-compute[74658]:       <mac address="fa:16:3e:04:77:38"/>
Nov 16 15:31:05 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:31:05 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:31:05 user nova-compute[74658]:       <target dev="tap8845dcec-73"/>
Nov 16 15:31:05 user nova-compute[74658]:     </interface>
Nov 16 15:31:05 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:31:05 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/console.log" append="off"/>
Nov 16 15:31:05 user nova-compute[74658]:     </serial>
Nov 16 15:31:05 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:31:05 user nova-compute[74658]:     <video>
Nov 16 15:31:05 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:31:05 user nova-compute[74658]:     </video>
Nov 16 15:31:05 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:31:05 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:31:05 user nova-compute[74658]:     </rng>
Nov 16 15:31:05 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:31:05 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:31:05 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:31:05 user nova-compute[74658]:     </memballoon>
Nov 16 15:31:05 user nova-compute[74658]:   </devices>
Nov 16 15:31:05 user nova-compute[74658]: </domain>
Nov 16 15:31:05 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-174035878',display_name='tempest-TestMinimumBasicScenario-server-174035878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-174035878',id=32,image_ref='098e0374-5ed5-4205-a769-10246231155b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBIKmwP0Z3hrk2u+0gQzlRnl15DqtD4JoLKfZeH2Yri7kluGPHjzvkxR33OpxHAO4/oNqUyhLh+7S9PevC2gOFslM/ehoL0M8iur8zX2pZwvXOjl+Ob1XoZwm/Ubsgc4w==',key_name='tempest-TestMinimumBasicScenario-1412037814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08549dcd4d26408098316f61ca4a6ee2',ramdisk_id='',reservation_id='r-bzp4qcu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='098e0374-5ed5-4205-a769-10246231155b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1910079629',owner_user_name='tempest-TestMinimumBasicScenario-1910079629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:31:03Z,user_data=None,user_id='d3cee7d0742148a1808713d978dbd01b',uuid=ecc12081-92a2-47e0-a885-efd13f9b5965,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converting VIF {"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:77:38,bridge_name='br-int',has_traffic_filtering=True,id=8845dcec-73a4-4fbc-a835-88ced3593d56,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dcec-73') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG os_vif [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:77:38,bridge_name='br-int',has_traffic_filtering=True,id=8845dcec-73a4-4fbc-a835-88ced3593d56,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dcec-73') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f03f2d7e-2f77-5d41-9a5b-794b2caadb4d', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8845dcec-73, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8845dcec-73, col_values=(('qos', UUID('c23e925a-463c-4656-b311-fa34010b12f9')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8845dcec-73, col_values=(('external_ids', {'iface-id': '8845dcec-73a4-4fbc-a835-88ced3593d56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:77:38', 'vm-uuid': 'ecc12081-92a2-47e0-a885-efd13f9b5965'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:05 user nova-compute[74658]: INFO os_vif [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:77:38,bridge_name='br-int',has_traffic_filtering=True,id=8845dcec-73a4-4fbc-a835-88ced3593d56,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dcec-73')
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] No VIF found with MAC fa:16:3e:04:77:38, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.network.neutron [req-3b5b59d3-f369-4f35-b436-ba686187caaf req-9b64ac77-41a7-45cb-b4c0-eab9cbc0c0e5 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updated VIF entry in instance network info cache for port 8845dcec-73a4-4fbc-a835-88ced3593d56. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG nova.network.neutron [req-3b5b59d3-f369-4f35-b436-ba686187caaf req-9b64ac77-41a7-45cb-b4c0-eab9cbc0c0e5 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updating instance_info_cache with network_info: [{"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:31:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3b5b59d3-f369-4f35-b436-ba686187caaf req-9b64ac77-41a7-45cb-b4c0-eab9cbc0c0e5 service nova] Releasing lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:31:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-51ffea25-df1b-4657-96da-eb587e7d3da8 req-a8806071-c951-4e87-b76b-9f11ff63f5a7 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-51ffea25-df1b-4657-96da-eb587e7d3da8 req-a8806071-c951-4e87-b76b-9f11ff63f5a7 service nova] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-51ffea25-df1b-4657-96da-eb587e7d3da8 req-a8806071-c951-4e87-b76b-9f11ff63f5a7 service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-51ffea25-df1b-4657-96da-eb587e7d3da8 req-a8806071-c951-4e87-b76b-9f11ff63f5a7 service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-51ffea25-df1b-4657-96da-eb587e7d3da8 req-a8806071-c951-4e87-b76b-9f11ff63f5a7 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] No waiting events found dispatching network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:06 user nova-compute[74658]: WARNING nova.compute.manager [req-51ffea25-df1b-4657-96da-eb587e7d3da8 req-a8806071-c951-4e87-b76b-9f11ff63f5a7 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received unexpected event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 for instance with vm_state building and task_state spawning.
Nov 16 15:31:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:31:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:31:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:31:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Instance spawned successfully.
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-9db1b170-9087-4624-81c2-a17648a0f122 req-968e185d-565a-4a25-96be-4a2060805fdf service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9db1b170-9087-4624-81c2-a17648a0f122 req-968e185d-565a-4a25-96be-4a2060805fdf service nova] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9db1b170-9087-4624-81c2-a17648a0f122 req-968e185d-565a-4a25-96be-4a2060805fdf service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9db1b170-9087-4624-81c2-a17648a0f122 req-968e185d-565a-4a25-96be-4a2060805fdf service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-9db1b170-9087-4624-81c2-a17648a0f122 req-968e185d-565a-4a25-96be-4a2060805fdf service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] No waiting events found dispatching network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:08 user nova-compute[74658]: WARNING nova.compute.manager [req-9db1b170-9087-4624-81c2-a17648a0f122 req-968e185d-565a-4a25-96be-4a2060805fdf service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received unexpected event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 for instance with vm_state building and task_state spawning.
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:08 user nova-compute[74658]: INFO nova.compute.manager [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 16 15:31:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:31:08 user nova-compute[74658]: INFO nova.compute.manager [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Took 6.63 seconds to build instance.
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7a5da25-1fa8-46d4-9768-2ec29f3875cb tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.746s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6c8dd806-c294-40dd-a13d-63659a1d5669 is timed out.
Nov 16 15:31:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully detached device vdb from instance 6c8dd806-c294-40dd-a13d-63659a1d5669 from the live domain config.
Nov 16 15:31:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLMgEmIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:31:09 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7535e1-ae97-4c13-ba03-27edc1cd8e7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:31:09 user nova-compute[74658]: No targets found.
Nov 16 15:31:09 user nova-compute[74658]: iSNS:
Nov 16 15:31:09 user nova-compute[74658]: No targets found.
Nov 16 15:31:09 user nova-compute[74658]: STATIC:
Nov 16 15:31:09 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b
Nov 16 15:31:09 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:31:09 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:31:09 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11
Nov 16 15:31:09 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:31:09 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:31:09 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0
Nov 16 15:31:09 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:31:09 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:31:09 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a
Nov 16 15:31:09 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:31:09 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:31:09 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44
Nov 16 15:31:09 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:31:09 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:31:09 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7
Nov 16 15:31:09 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:31:09 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:31:09 user nova-compute[74658]: FIRMWARE:
Nov 16 15:31:09 user nova-compute[74658]: No targets found.
Nov 16 15:31:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:31:09 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:31:09 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[54de1dd3-d12f-423f-83fc-7784273ac39c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[512122cc-3a9b-45dc-a56f-6a969e90b1f8]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:31:09 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:31:09 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:31:09 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:31:09 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:31:09 user nova-compute[74658]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)
Nov 16 15:31:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:31:09 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:31:09 user nova-compute[74658]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 (non-flash)
Nov 16 15:31:09 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:31:09 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:31:09 user nova-compute[74658]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)
Nov 16 15:31:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0730461d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d903d3b5-82ea-4ca2-9284-0092ac2bd235]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee2c4b2-f569-4c76-a9a0-df83ec5c75d3]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb7df29-6273-487d-a02a-722e324f3546]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f8d8a9-81f9-4936-9122-526e4a27576a]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea99b8d-dc24-4892-afc4-8501148f6d65]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1b16dc-37a0-49da-a907-f5f700beae84]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260]
Nov 16 15:31:09 user nova-compute[74658]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7, portal: 172.16.0.220,3260] successful.
Nov 16 15:31:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e403a0a-3fdc-495b-a0fb-5f05422f3ea7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c50e33-cc2a-4d60-8ae7-5d7dcb073c49]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] <== disconnect_volume: return (364ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:31:10 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:31:10 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7567MB free_disk=25.18187713623047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ac91cac3-1dbf-440b-b67a-f5a5aebcb351 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.237s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Applying migration context for instance 67d2aeee-7218-4e85-baa3-157643a4301e as it has an incoming, in-progress migration 47fe44cb-3725-4a35-a2ba-ff5ef332a9c7. Migration status is finished {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 15:31:10 user nova-compute[74658]: INFO nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating resource usage from migration 47fe44cb-3725-4a35-a2ba-ff5ef332a9c7
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6c8dd806-c294-40dd-a13d-63659a1d5669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 97135af5-e020-482b-a54b-6cf30a5443d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 5834c073-5392-40f8-bd69-8e7b50cd42ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance b6a0ca45-19d0-4644-8e65-fe904d85e1c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 456b73b3-0723-4faa-8a7e-8f25fa0ead66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 03a85a50-fb48-414a-abb2-7e03a3423d14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Migration 47fe44cb-3725-4a35-a2ba-ff5ef332a9c7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 67d2aeee-7218-4e85-baa3-157643a4301e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance f314ad85-524a-4326-bdd5-2c7c4de78690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ecc12081-92a2-47e0-a885-efd13f9b5965 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:31:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ce717ba7-4244-442c-8f2f-030c4cdb9ebd tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ce717ba7-4244-442c-8f2f-030c4cdb9ebd tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ce717ba7-4244-442c-8f2f-030c4cdb9ebd tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ce717ba7-4244-442c-8f2f-030c4cdb9ebd tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74658) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ce717ba7-4244-442c-8f2f-030c4cdb9ebd tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-4c0c2e54-9336-49dc-a7d3-86a38a0fe691 req-019f5b79-9297-45f9-ac7c-817bcf38af13 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-unplugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4c0c2e54-9336-49dc-a7d3-86a38a0fe691 req-019f5b79-9297-45f9-ac7c-817bcf38af13 service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4c0c2e54-9336-49dc-a7d3-86a38a0fe691 req-019f5b79-9297-45f9-ac7c-817bcf38af13 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4c0c2e54-9336-49dc-a7d3-86a38a0fe691 req-019f5b79-9297-45f9-ac7c-817bcf38af13 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-4c0c2e54-9336-49dc-a7d3-86a38a0fe691 req-019f5b79-9297-45f9-ac7c-817bcf38af13 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-unplugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:11 user nova-compute[74658]: WARNING nova.compute.manager [req-4c0c2e54-9336-49dc-a7d3-86a38a0fe691 req-019f5b79-9297-45f9-ac7c-817bcf38af13 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received unexpected event network-vif-unplugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with vm_state active and task_state powering-off.
Nov 16 15:31:12 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance destroyed successfully.
Nov 16 15:31:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ce717ba7-4244-442c-8f2f-030c4cdb9ebd tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:31:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ce717ba7-4244-442c-8f2f-030c4cdb9ebd tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.877s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:31:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:31:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:31:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:31:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:31:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:31:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-34882949-7e89-43af-bdd1-bf8a854c3fb9 req-c78f4a99-1b92-4c1e-bb8c-5113c29b5623 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34882949-7e89-43af-bdd1-bf8a854c3fb9 req-c78f4a99-1b92-4c1e-bb8c-5113c29b5623 service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34882949-7e89-43af-bdd1-bf8a854c3fb9 req-c78f4a99-1b92-4c1e-bb8c-5113c29b5623 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34882949-7e89-43af-bdd1-bf8a854c3fb9 req-c78f4a99-1b92-4c1e-bb8c-5113c29b5623 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-34882949-7e89-43af-bdd1-bf8a854c3fb9 req-c78f4a99-1b92-4c1e-bb8c-5113c29b5623 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:13 user nova-compute[74658]: WARNING nova.compute.manager [req-34882949-7e89-43af-bdd1-bf8a854c3fb9 req-c78f4a99-1b92-4c1e-bb8c-5113c29b5623 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received unexpected event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with vm_state stopped and task_state None.
Nov 16 15:31:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:25 user nova-compute[74658]: INFO nova.compute.manager [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Terminating instance
Nov 16 15:31:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:31:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-0743f2ac-736f-4db6-8b42-0c85855e3d55 req-3e08fec8-c6f5-4787-99da-127a9925fdb0 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Received event network-vif-unplugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0743f2ac-736f-4db6-8b42-0c85855e3d55 req-3e08fec8-c6f5-4787-99da-127a9925fdb0 service nova] Acquiring lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0743f2ac-736f-4db6-8b42-0c85855e3d55 req-3e08fec8-c6f5-4787-99da-127a9925fdb0 service nova] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0743f2ac-736f-4db6-8b42-0c85855e3d55 req-3e08fec8-c6f5-4787-99da-127a9925fdb0 service nova] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-0743f2ac-736f-4db6-8b42-0c85855e3d55 req-3e08fec8-c6f5-4787-99da-127a9925fdb0 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] No waiting events found dispatching network-vif-unplugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-0743f2ac-736f-4db6-8b42-0c85855e3d55 req-3e08fec8-c6f5-4787-99da-127a9925fdb0 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Received event network-vif-unplugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:31:26 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Instance destroyed successfully.
Nov 16 15:31:26 user nova-compute[74658]: DEBUG nova.objects.instance [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lazy-loading 'resources' on Instance uuid 456b73b3-0723-4faa-8a7e-8f25fa0ead66 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-854995960',display_name='tempest-VolumesActionsTest-instance-854995960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-854995960',id=30,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:29:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='315f2a06d6c0433a9846b31ff1c5ab34',ramdisk_id='',reservation_id='r-oy4flr9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-330921490',owner_user_name='tempest-VolumesActionsTest-330921490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:29:41Z,user_data=None,user_id='366e499875f84191b530cb66cc0ed9dd',uuid=456b73b3-0723-4faa-8a7e-8f25fa0ead66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "address": "fa:16:3e:12:7e:ee", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1614ff1d-15", "ovs_interfaceid": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converting VIF {"id": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "address": "fa:16:3e:12:7e:ee", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1614ff1d-15", "ovs_interfaceid": "1614ff1d-154e-41f7-b5ba-d6b95265a493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:7e:ee,bridge_name='br-int',has_traffic_filtering=True,id=1614ff1d-154e-41f7-b5ba-d6b95265a493,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1614ff1d-15') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG os_vif [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:7e:ee,bridge_name='br-int',has_traffic_filtering=True,id=1614ff1d-154e-41f7-b5ba-d6b95265a493,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1614ff1d-15') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1614ff1d-15, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50f99505-a5c9-491b-9f70-e959244e1449) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:26 user nova-compute[74658]: INFO os_vif [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:7e:ee,bridge_name='br-int',has_traffic_filtering=True,id=1614ff1d-154e-41f7-b5ba-d6b95265a493,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1614ff1d-15')
Nov 16 15:31:26 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Deleting instance files /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66_del
Nov 16 15:31:26 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Deletion of /opt/stack/data/nova/instances/456b73b3-0723-4faa-8a7e-8f25fa0ead66_del complete
Nov 16 15:31:26 user nova-compute[74658]: INFO nova.compute.manager [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 15:31:26 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:31:26 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:31:27 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:31:27 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Took 0.71 seconds to deallocate network for instance.
Nov 16 15:31:27 user nova-compute[74658]: DEBUG nova.compute.manager [req-32391b00-467b-4a84-bb39-e85aa35ce9b5 req-3d97b54b-5107-4538-9ccd-f6ec10cd2d8d service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Received event network-vif-deleted-1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:27 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:31:27 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:31:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:27 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Deleted allocations for instance 456b73b3-0723-4faa-8a7e-8f25fa0ead66
Nov 16 15:31:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-35c7bdc0-7e3e-46ae-8171-caf4afe3f0bb tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-5fa5e50d-b2f7-42d7-9d15-1843414ed71e req-825a7a16-064d-4814-b599-b1b468707227 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Received event network-vif-plugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5fa5e50d-b2f7-42d7-9d15-1843414ed71e req-825a7a16-064d-4814-b599-b1b468707227 service nova] Acquiring lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5fa5e50d-b2f7-42d7-9d15-1843414ed71e req-825a7a16-064d-4814-b599-b1b468707227 service nova] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5fa5e50d-b2f7-42d7-9d15-1843414ed71e req-825a7a16-064d-4814-b599-b1b468707227 service nova] Lock "456b73b3-0723-4faa-8a7e-8f25fa0ead66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-5fa5e50d-b2f7-42d7-9d15-1843414ed71e req-825a7a16-064d-4814-b599-b1b468707227 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] No waiting events found dispatching network-vif-plugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:28 user nova-compute[74658]: WARNING nova.compute.manager [req-5fa5e50d-b2f7-42d7-9d15-1843414ed71e req-825a7a16-064d-4814-b599-b1b468707227 service nova] [instance: 456b73b3-0723-4faa-8a7e-8f25fa0ead66] Received unexpected event network-vif-plugged-1614ff1d-154e-41f7-b5ba-d6b95265a493 for instance with vm_state deleted and task_state None.
Nov 16 15:31:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8cf4b74-13ea-4aeb-94d3-397169e6c633 req-df768948-cd7a-46b1-be6a-5e1137784524 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Received event network-changed-2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-a8cf4b74-13ea-4aeb-94d3-397169e6c633 req-df768948-cd7a-46b1-be6a-5e1137784524 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Refreshing instance network info cache due to event network-changed-2bfac405-c913-4039-b536-6766651df18f. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:31:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8cf4b74-13ea-4aeb-94d3-397169e6c633 req-df768948-cd7a-46b1-be6a-5e1137784524 service nova] Acquiring lock "refresh_cache-03a85a50-fb48-414a-abb2-7e03a3423d14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:31:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8cf4b74-13ea-4aeb-94d3-397169e6c633 req-df768948-cd7a-46b1-be6a-5e1137784524 service nova] Acquired lock "refresh_cache-03a85a50-fb48-414a-abb2-7e03a3423d14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:31:45 user nova-compute[74658]: DEBUG nova.network.neutron [req-a8cf4b74-13ea-4aeb-94d3-397169e6c633 req-df768948-cd7a-46b1-be6a-5e1137784524 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Refreshing network info cache for port 2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG nova.network.neutron [req-a8cf4b74-13ea-4aeb-94d3-397169e6c633 req-df768948-cd7a-46b1-be6a-5e1137784524 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Updated VIF entry in instance network info cache for port 2bfac405-c913-4039-b536-6766651df18f. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG nova.network.neutron [req-a8cf4b74-13ea-4aeb-94d3-397169e6c633 req-df768948-cd7a-46b1-be6a-5e1137784524 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Updating instance_info_cache with network_info: [{"id": "2bfac405-c913-4039-b536-6766651df18f", "address": "fa:16:3e:e3:92:bb", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfac405-c9", "ovs_interfaceid": "2bfac405-c913-4039-b536-6766651df18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a8cf4b74-13ea-4aeb-94d3-397169e6c633 req-df768948-cd7a-46b1-be6a-5e1137784524 service nova] Releasing lock "refresh_cache-03a85a50-fb48-414a-abb2-7e03a3423d14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "03a85a50-fb48-414a-abb2-7e03a3423d14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:46 user nova-compute[74658]: INFO nova.compute.manager [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Terminating instance
Nov 16 15:31:46 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-87844654-d788-4bfe-92d3-d061aa651ea9 req-95af37be-2299-4895-99e8-2096bc6e0227 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Received event network-vif-unplugged-2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-87844654-d788-4bfe-92d3-d061aa651ea9 req-95af37be-2299-4895-99e8-2096bc6e0227 service nova] Acquiring lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-87844654-d788-4bfe-92d3-d061aa651ea9 req-95af37be-2299-4895-99e8-2096bc6e0227 service nova] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-87844654-d788-4bfe-92d3-d061aa651ea9 req-95af37be-2299-4895-99e8-2096bc6e0227 service nova] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-87844654-d788-4bfe-92d3-d061aa651ea9 req-95af37be-2299-4895-99e8-2096bc6e0227 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] No waiting events found dispatching network-vif-unplugged-2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-87844654-d788-4bfe-92d3-d061aa651ea9 req-95af37be-2299-4895-99e8-2096bc6e0227 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Received event network-vif-unplugged-2bfac405-c913-4039-b536-6766651df18f for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Instance destroyed successfully.
Nov 16 15:31:47 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'resources' on Instance uuid 03a85a50-fb48-414a-abb2-7e03a3423d14 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1398418856',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1398418856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1398418856',id=31,image_ref='9bc0388b-096e-4141-86fc-02dfa0abd8f2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKovpO8PHwwK8fuB9/ZKmPWPhikJqMXbq7jyP1AYK8Tk1Ls5FQiLFrbVOtPWD/qFqAxQ+P9PyXs3G6fRZhrsBpNnmopfFPF8UwRQhieYX/Bs0Uly0JJ560j7VvGCDodg7A==',key_name='tempest-keypair-2030433190',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:30:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-lafcmwz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1853010836',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:30:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=03a85a50-fb48-414a-abb2-7e03a3423d14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bfac405-c913-4039-b536-6766651df18f", "address": "fa:16:3e:e3:92:bb", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfac405-c9", "ovs_interfaceid": "2bfac405-c913-4039-b536-6766651df18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "2bfac405-c913-4039-b536-6766651df18f", "address": "fa:16:3e:e3:92:bb", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfac405-c9", "ovs_interfaceid": "2bfac405-c913-4039-b536-6766651df18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:92:bb,bridge_name='br-int',has_traffic_filtering=True,id=2bfac405-c913-4039-b536-6766651df18f,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfac405-c9') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_vif [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:92:bb,bridge_name='br-int',has_traffic_filtering=True,id=2bfac405-c913-4039-b536-6766651df18f,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfac405-c9') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bfac405-c9, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c10a279c-6536-435e-810f-19e0f761a180) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:47 user nova-compute[74658]: INFO os_vif [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:92:bb,bridge_name='br-int',has_traffic_filtering=True,id=2bfac405-c913-4039-b536-6766651df18f,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfac405-c9')
Nov 16 15:31:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlaMDRpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:31:47 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f6d5f3-e90a-48e4-9a05-51d435631536]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:31:47 user nova-compute[74658]: No targets found.
Nov 16 15:31:47 user nova-compute[74658]: iSNS:
Nov 16 15:31:47 user nova-compute[74658]: No targets found.
Nov 16 15:31:47 user nova-compute[74658]: STATIC:
Nov 16 15:31:47 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b
Nov 16 15:31:47 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:31:47 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:31:47 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11
Nov 16 15:31:47 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:31:47 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:31:47 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0
Nov 16 15:31:47 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:31:47 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:31:47 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a
Nov 16 15:31:47 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:31:47 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:31:47 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44
Nov 16 15:31:47 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:31:47 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:31:47 user nova-compute[74658]: FIRMWARE:
Nov 16 15:31:47 user nova-compute[74658]: No targets found.
Nov 16 15:31:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:31:47 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:31:47 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[680eb9b2-c360-4760-8188-074a4cc667ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b24c82-4144-476a-97bd-1689eee590b7]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:31:47 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:31:47 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:31:47 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:31:47 user nova-compute[74658]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)
Nov 16 15:31:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:31:47 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:31:47 user nova-compute[74658]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b (non-flash)
Nov 16 15:31:47 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:31:47 user nova-compute[74658]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)
Nov 16 15:31:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f071015b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[990613b0-38f8-43c6-949f-26292a372bd7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c717e7a8-7d17-4ef0-8196-c5481dcd3131]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf81855-f345-4300-b167-8c477fad2031]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb11545a-5846-4b72-872d-55914136df15]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1cfa5a-3d98-4d82-8397-930a10abb5c1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b1eea7-f711-4cfd-8a68-612fd603b39a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b, portal: 172.16.0.220,3260]
Nov 16 15:31:47 user nova-compute[74658]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b, portal: 172.16.0.220,3260] successful.
Nov 16 15:31:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a754835-1372-4389-9f8c-f3d780e06b2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a968b4-c520-41b6-a921-4f311e528c7d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== disconnect_volume: return (316ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:31:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Deleting instance files /opt/stack/data/nova/instances/03a85a50-fb48-414a-abb2-7e03a3423d14_del
Nov 16 15:31:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Deletion of /opt/stack/data/nova/instances/03a85a50-fb48-414a-abb2-7e03a3423d14_del complete
Nov 16 15:31:47 user nova-compute[74658]: INFO nova.compute.manager [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 16 15:31:47 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:31:47 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:31:48 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:31:48 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Took 0.82 seconds to deallocate network for instance.
Nov 16 15:31:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-433084c8-5df7-4750-8d7f-f8714b2a89c3 req-e0e74ada-4eab-4353-baa6-25c0cb91c403 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Received event network-vif-plugged-2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-433084c8-5df7-4750-8d7f-f8714b2a89c3 req-e0e74ada-4eab-4353-baa6-25c0cb91c403 service nova] Acquiring lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-433084c8-5df7-4750-8d7f-f8714b2a89c3 req-e0e74ada-4eab-4353-baa6-25c0cb91c403 service nova] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-433084c8-5df7-4750-8d7f-f8714b2a89c3 req-e0e74ada-4eab-4353-baa6-25c0cb91c403 service nova] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-433084c8-5df7-4750-8d7f-f8714b2a89c3 req-e0e74ada-4eab-4353-baa6-25c0cb91c403 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] No waiting events found dispatching network-vif-plugged-2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:48 user nova-compute[74658]: WARNING nova.compute.manager [req-433084c8-5df7-4750-8d7f-f8714b2a89c3 req-e0e74ada-4eab-4353-baa6-25c0cb91c403 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Received unexpected event network-vif-plugged-2bfac405-c913-4039-b536-6766651df18f for instance with vm_state active and task_state deleting.
Nov 16 15:31:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-433084c8-5df7-4750-8d7f-f8714b2a89c3 req-e0e74ada-4eab-4353-baa6-25c0cb91c403 service nova] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Received event network-vif-deleted-2bfac405-c913-4039-b536-6766651df18f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:49 user nova-compute[74658]: INFO nova.compute.manager [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Took 0.72 seconds to detach 1 volumes for instance.
Nov 16 15:31:49 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 03a85a50-fb48-414a-abb2-7e03a3423d14] Deleting volume: 3a754835-1372-4389-9f8c-f3d780e06b2b {{(pid=74658) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 15:31:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:49 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:31:49 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:31:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:49 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Deleted allocations for instance 03a85a50-fb48-414a-abb2-7e03a3423d14
Nov 16 15:31:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae277570-e8d9-409c-9a52-36fa815530a4 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "03a85a50-fb48-414a-abb2-7e03a3423d14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.296s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:51 user nova-compute[74658]: INFO nova.compute.manager [None req-97d7bd79-8075-41d3-ae66-a0c6c0c925fd tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Unrescuing
Nov 16 15:31:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-97d7bd79-8075-41d3-ae66-a0c6c0c925fd tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:31:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-97d7bd79-8075-41d3-ae66-a0c6c0c925fd tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquired lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:31:51 user nova-compute[74658]: DEBUG nova.network.neutron [None req-97d7bd79-8075-41d3-ae66-a0c6c0c925fd tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG nova.network.neutron [None req-97d7bd79-8075-41d3-ae66-a0c6c0c925fd tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Updating instance_info_cache with network_info: [{"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-97d7bd79-8075-41d3-ae66-a0c6c0c925fd tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Releasing lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG nova.objects.instance [None req-97d7bd79-8075-41d3-ae66-a0c6c0c925fd tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'flavor' on Instance uuid b6a0ca45-19d0-4644-8e65-fe904d85e1c1 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-7605f154-4d15-4a88-82ed-bc18d41b8b2e req-502d4217-f11f-4c35-8707-8b5576d9b957 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-unplugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7605f154-4d15-4a88-82ed-bc18d41b8b2e req-502d4217-f11f-4c35-8707-8b5576d9b957 service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7605f154-4d15-4a88-82ed-bc18d41b8b2e req-502d4217-f11f-4c35-8707-8b5576d9b957 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7605f154-4d15-4a88-82ed-bc18d41b8b2e req-502d4217-f11f-4c35-8707-8b5576d9b957 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-7605f154-4d15-4a88-82ed-bc18d41b8b2e req-502d4217-f11f-4c35-8707-8b5576d9b957 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-unplugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:52 user nova-compute[74658]: WARNING nova.compute.manager [req-7605f154-4d15-4a88-82ed-bc18d41b8b2e req-502d4217-f11f-4c35-8707-8b5576d9b957 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received unexpected event network-vif-unplugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:31:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Instance destroyed successfully.
Nov 16 15:31:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-715cab3f-d5aa-4c2d-aaa4-bad174a6ef83 req-8e36e55c-73f2-4308-8a91-cd372df640a8 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-715cab3f-d5aa-4c2d-aaa4-bad174a6ef83 req-8e36e55c-73f2-4308-8a91-cd372df640a8 service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-715cab3f-d5aa-4c2d-aaa4-bad174a6ef83 req-8e36e55c-73f2-4308-8a91-cd372df640a8 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-715cab3f-d5aa-4c2d-aaa4-bad174a6ef83 req-8e36e55c-73f2-4308-8a91-cd372df640a8 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-715cab3f-d5aa-4c2d-aaa4-bad174a6ef83 req-8e36e55c-73f2-4308-8a91-cd372df640a8 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:54 user nova-compute[74658]: WARNING nova.compute.manager [req-715cab3f-d5aa-4c2d-aaa4-bad174a6ef83 req-8e36e55c-73f2-4308-8a91-cd372df640a8 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received unexpected event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:31:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:31:56 user nova-compute[74658]: DEBUG nova.compute.manager [None req-97d7bd79-8075-41d3-ae66-a0c6c0c925fd tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:31:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:56 user nova-compute[74658]: WARNING nova.compute.manager [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received unexpected event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with vm_state active and task_state None.
Nov 16 15:31:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:31:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:31:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:31:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:31:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:31:56 user nova-compute[74658]: WARNING nova.compute.manager [req-dbd30b82-756b-4d31-9d05-15b8bc532b6b req-2dcbe23f-0f5d-468a-94be-9d40e55214f0 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received unexpected event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with vm_state active and task_state None.
Nov 16 15:31:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:32:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:32:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:32:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:32:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:32:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-97135af5-e020-482b-a54b-6cf30a5443d4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-97135af5-e020-482b-a54b-6cf30a5443d4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Updating instance_info_cache with network_info: [{"id": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "address": "fa:16:3e:dd:4c:bc", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ab6143-11", "ovs_interfaceid": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-97135af5-e020-482b-a54b-6cf30a5443d4" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:32:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:32:08 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:32:08 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7925MB free_disk=25.180580139160156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Applying migration context for instance 67d2aeee-7218-4e85-baa3-157643a4301e as it has an incoming, in-progress migration 47fe44cb-3725-4a35-a2ba-ff5ef332a9c7. Migration status is finished {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 15:32:08 user nova-compute[74658]: INFO nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating resource usage from migration 47fe44cb-3725-4a35-a2ba-ff5ef332a9c7
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6c8dd806-c294-40dd-a13d-63659a1d5669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 97135af5-e020-482b-a54b-6cf30a5443d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 5834c073-5392-40f8-bd69-8e7b50cd42ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance b6a0ca45-19d0-4644-8e65-fe904d85e1c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Migration 47fe44cb-3725-4a35-a2ba-ff5ef332a9c7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 67d2aeee-7218-4e85-baa3-157643a4301e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance f314ad85-524a-4326-bdd5-2c7c4de78690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ecc12081-92a2-47e0-a885-efd13f9b5965 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:32:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:32:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:32:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:32:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:32:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:32:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "67d2aeee-7218-4e85-baa3-157643a4301e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Going to confirm migration 2 {{(pid=74658) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 16 15:32:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:32:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquired lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:32:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:32:11 user nova-compute[74658]: DEBUG nova.objects.instance [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'info_cache' on Instance uuid 67d2aeee-7218-4e85-baa3-157643a4301e {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:32:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:12 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:32:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating instance_info_cache with network_info: [{"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:32:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Releasing lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:32:12 user nova-compute[74658]: DEBUG nova.objects.instance [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'migration_context' on Instance uuid 67d2aeee-7218-4e85-baa3-157643a4301e {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:32:12 user nova-compute[74658]: DEBUG nova.objects.base [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Object Instance<67d2aeee-7218-4e85-baa3-157643a4301e> lazy-loaded attributes: info_cache,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:32:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:12 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:32:12 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:32:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.338s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:12 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Deleted allocation for migration 47fe44cb-3725-4a35-a2ba-ff5ef332a9c7
Nov 16 15:32:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-678f77aa-f3e7-491a-91d2-f0d4c453ff41 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "67d2aeee-7218-4e85-baa3-157643a4301e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.223s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:32:17 user nova-compute[74658]: INFO nova.compute.claims [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Claim successful on node user
Nov 16 15:32:17 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:32:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:32:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:32:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Creating image(s)
Nov 16 15:32:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "/opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "/opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "/opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:17 user nova-compute[74658]: DEBUG nova.policy [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '366e499875f84191b530cb66cc0ed9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f2a06d6c0433a9846b31ff1c5ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk 1073741824" returned: 0 in 0.059s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.198s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Successfully created port: 19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Cannot resize image /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Ensure instance console log exists: /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Successfully updated port: 19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "refresh_cache-60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquired lock "refresh_cache-60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-50ddaab8-1568-461f-8118-dad2bd968eed req-a70eea63-2a85-4698-a8c8-ccc97363c34c service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Received event network-changed-19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-50ddaab8-1568-461f-8118-dad2bd968eed req-a70eea63-2a85-4698-a8c8-ccc97363c34c service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Refreshing instance network info cache due to event network-changed-19d2fb15-214c-4db9-97c0-84013963d15a. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-50ddaab8-1568-461f-8118-dad2bd968eed req-a70eea63-2a85-4698-a8c8-ccc97363c34c service nova] Acquiring lock "refresh_cache-60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Updating instance_info_cache with network_info: [{"id": "19d2fb15-214c-4db9-97c0-84013963d15a", "address": "fa:16:3e:67:52:61", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d2fb15-21", "ovs_interfaceid": "19d2fb15-214c-4db9-97c0-84013963d15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Releasing lock "refresh_cache-60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Instance network_info: |[{"id": "19d2fb15-214c-4db9-97c0-84013963d15a", "address": "fa:16:3e:67:52:61", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d2fb15-21", "ovs_interfaceid": "19d2fb15-214c-4db9-97c0-84013963d15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-50ddaab8-1568-461f-8118-dad2bd968eed req-a70eea63-2a85-4698-a8c8-ccc97363c34c service nova] Acquired lock "refresh_cache-60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.network.neutron [req-50ddaab8-1568-461f-8118-dad2bd968eed req-a70eea63-2a85-4698-a8c8-ccc97363c34c service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Refreshing network info cache for port 19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Start _get_guest_xml network_info=[{"id": "19d2fb15-214c-4db9-97c0-84013963d15a", "address": "fa:16:3e:67:52:61", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d2fb15-21", "ovs_interfaceid": "19d2fb15-214c-4db9-97c0-84013963d15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:32:19 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:32:19 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-636598775',display_name='tempest-VolumesActionsTest-instance-636598775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-636598775',id=33,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='315f2a06d6c0433a9846b31ff1c5ab34',ramdisk_id='',reservation_id='r-yqmc1ebb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-330921490',owner_user_name='tempest-VolumesActionsTest-330921490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:32:18Z,user_data=None,user_id='366e499875f84191b530cb66cc0ed9dd',uuid=60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19d2fb15-214c-4db9-97c0-84013963d15a", "address": "fa:16:3e:67:52:61", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d2fb15-21", "ovs_interfaceid": "19d2fb15-214c-4db9-97c0-84013963d15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converting VIF {"id": "19d2fb15-214c-4db9-97c0-84013963d15a", "address": "fa:16:3e:67:52:61", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d2fb15-21", "ovs_interfaceid": "19d2fb15-214c-4db9-97c0-84013963d15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:61,bridge_name='br-int',has_traffic_filtering=True,id=19d2fb15-214c-4db9-97c0-84013963d15a,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d2fb15-21') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.objects.instance [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lazy-loading 'pci_devices' on Instance uuid 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:32:19 user nova-compute[74658]:   <uuid>60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb</uuid>
Nov 16 15:32:19 user nova-compute[74658]:   <name>instance-00000021</name>
Nov 16 15:32:19 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:32:19 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:32:19 user nova-compute[74658]:   <metadata>
Nov 16 15:32:19 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:32:19 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:32:19 user nova-compute[74658]:       <nova:name>tempest-VolumesActionsTest-instance-636598775</nova:name>
Nov 16 15:32:19 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:32:19</nova:creationTime>
Nov 16 15:32:19 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:32:19 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:32:19 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:32:19 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:32:19 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:32:19 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:32:19 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:32:19 user nova-compute[74658]:       <nova:owner>
Nov 16 15:32:19 user nova-compute[74658]:         <nova:user uuid="366e499875f84191b530cb66cc0ed9dd">tempest-VolumesActionsTest-330921490-project-member</nova:user>
Nov 16 15:32:19 user nova-compute[74658]:         <nova:project uuid="315f2a06d6c0433a9846b31ff1c5ab34">tempest-VolumesActionsTest-330921490</nova:project>
Nov 16 15:32:19 user nova-compute[74658]:       </nova:owner>
Nov 16 15:32:19 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:32:19 user nova-compute[74658]:       <nova:ports>
Nov 16 15:32:19 user nova-compute[74658]:         <nova:port uuid="19d2fb15-214c-4db9-97c0-84013963d15a">
Nov 16 15:32:19 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 15:32:19 user nova-compute[74658]:         </nova:port>
Nov 16 15:32:19 user nova-compute[74658]:       </nova:ports>
Nov 16 15:32:19 user nova-compute[74658]:     </nova:instance>
Nov 16 15:32:19 user nova-compute[74658]:   </metadata>
Nov 16 15:32:19 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:32:19 user nova-compute[74658]:     <system>
Nov 16 15:32:19 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:32:19 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:32:19 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:32:19 user nova-compute[74658]:       <entry name="serial">60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb</entry>
Nov 16 15:32:19 user nova-compute[74658]:       <entry name="uuid">60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb</entry>
Nov 16 15:32:19 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:32:19 user nova-compute[74658]:     </system>
Nov 16 15:32:19 user nova-compute[74658]:   </sysinfo>
Nov 16 15:32:19 user nova-compute[74658]:   <os>
Nov 16 15:32:19 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:32:19 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:32:19 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:32:19 user nova-compute[74658]:   </os>
Nov 16 15:32:19 user nova-compute[74658]:   <features>
Nov 16 15:32:19 user nova-compute[74658]:     <acpi/>
Nov 16 15:32:19 user nova-compute[74658]:     <apic/>
Nov 16 15:32:19 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:32:19 user nova-compute[74658]:   </features>
Nov 16 15:32:19 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:32:19 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:32:19 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:32:19 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:32:19 user nova-compute[74658]:   </clock>
Nov 16 15:32:19 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:32:19 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:32:19 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:32:19 user nova-compute[74658]:   </cpu>
Nov 16 15:32:19 user nova-compute[74658]:   <devices>
Nov 16 15:32:19 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:32:19 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:32:19 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk"/>
Nov 16 15:32:19 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:32:19 user nova-compute[74658]:     </disk>
Nov 16 15:32:19 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:32:19 user nova-compute[74658]:       <mac address="fa:16:3e:67:52:61"/>
Nov 16 15:32:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:32:19 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:32:19 user nova-compute[74658]:       <target dev="tap19d2fb15-21"/>
Nov 16 15:32:19 user nova-compute[74658]:     </interface>
Nov 16 15:32:19 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:32:19 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/console.log" append="off"/>
Nov 16 15:32:19 user nova-compute[74658]:     </serial>
Nov 16 15:32:19 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:32:19 user nova-compute[74658]:     <video>
Nov 16 15:32:19 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:32:19 user nova-compute[74658]:     </video>
Nov 16 15:32:19 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:32:19 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:32:19 user nova-compute[74658]:     </rng>
Nov 16 15:32:19 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:32:19 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:32:19 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:32:19 user nova-compute[74658]:     </memballoon>
Nov 16 15:32:19 user nova-compute[74658]:   </devices>
Nov 16 15:32:19 user nova-compute[74658]: </domain>
Nov 16 15:32:19 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-636598775',display_name='tempest-VolumesActionsTest-instance-636598775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-636598775',id=33,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='315f2a06d6c0433a9846b31ff1c5ab34',ramdisk_id='',reservation_id='r-yqmc1ebb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-330921490',owner_user_name='tempest-VolumesActionsTest-330921490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:32:18Z,user_data=None,user_id='366e499875f84191b530cb66cc0ed9dd',uuid=60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19d2fb15-214c-4db9-97c0-84013963d15a", "address": "fa:16:3e:67:52:61", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d2fb15-21", "ovs_interfaceid": "19d2fb15-214c-4db9-97c0-84013963d15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converting VIF {"id": "19d2fb15-214c-4db9-97c0-84013963d15a", "address": "fa:16:3e:67:52:61", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d2fb15-21", "ovs_interfaceid": "19d2fb15-214c-4db9-97c0-84013963d15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:61,bridge_name='br-int',has_traffic_filtering=True,id=19d2fb15-214c-4db9-97c0-84013963d15a,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d2fb15-21') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG os_vif [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:61,bridge_name='br-int',has_traffic_filtering=True,id=19d2fb15-214c-4db9-97c0-84013963d15a,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d2fb15-21') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '920fdbf1-1b17-5f35-a9b0-65f29d9e6e6c', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19d2fb15-21, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19d2fb15-21, col_values=(('qos', UUID('47b63593-787a-4017-bfb2-281153c0c766')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19d2fb15-21, col_values=(('external_ids', {'iface-id': '19d2fb15-214c-4db9-97c0-84013963d15a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:52:61', 'vm-uuid': '60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:19 user nova-compute[74658]: INFO os_vif [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:61,bridge_name='br-int',has_traffic_filtering=True,id=19d2fb15-214c-4db9-97c0-84013963d15a,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d2fb15-21')
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] No VIF found with MAC fa:16:3e:67:52:61, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.network.neutron [req-50ddaab8-1568-461f-8118-dad2bd968eed req-a70eea63-2a85-4698-a8c8-ccc97363c34c service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Updated VIF entry in instance network info cache for port 19d2fb15-214c-4db9-97c0-84013963d15a. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG nova.network.neutron [req-50ddaab8-1568-461f-8118-dad2bd968eed req-a70eea63-2a85-4698-a8c8-ccc97363c34c service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Updating instance_info_cache with network_info: [{"id": "19d2fb15-214c-4db9-97c0-84013963d15a", "address": "fa:16:3e:67:52:61", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d2fb15-21", "ovs_interfaceid": "19d2fb15-214c-4db9-97c0-84013963d15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:32:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-50ddaab8-1568-461f-8118-dad2bd968eed req-a70eea63-2a85-4698-a8c8-ccc97363c34c service nova] Releasing lock "refresh_cache-60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:32:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-652ff398-963e-4937-9cb6-2e007c586e08 req-4e98c2fa-a6b0-4ca1-965b-3bbb99c01292 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Received event network-vif-plugged-19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:32:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-652ff398-963e-4937-9cb6-2e007c586e08 req-4e98c2fa-a6b0-4ca1-965b-3bbb99c01292 service nova] Acquiring lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-652ff398-963e-4937-9cb6-2e007c586e08 req-4e98c2fa-a6b0-4ca1-965b-3bbb99c01292 service nova] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-652ff398-963e-4937-9cb6-2e007c586e08 req-4e98c2fa-a6b0-4ca1-965b-3bbb99c01292 service nova] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-652ff398-963e-4937-9cb6-2e007c586e08 req-4e98c2fa-a6b0-4ca1-965b-3bbb99c01292 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] No waiting events found dispatching network-vif-plugged-19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:32:21 user nova-compute[74658]: WARNING nova.compute.manager [req-652ff398-963e-4937-9cb6-2e007c586e08 req-4e98c2fa-a6b0-4ca1-965b-3bbb99c01292 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Received unexpected event network-vif-plugged-19d2fb15-214c-4db9-97c0-84013963d15a for instance with vm_state building and task_state spawning.
Nov 16 15:32:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:32:23 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Instance spawned successfully.
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:32:23 user nova-compute[74658]: INFO nova.compute.manager [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-a9dc045c-f069-4ac2-a231-4eb3e456f9e6 req-aad92d11-4fa6-420d-ad29-8f6bf4af4b92 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Received event network-vif-plugged-19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a9dc045c-f069-4ac2-a231-4eb3e456f9e6 req-aad92d11-4fa6-420d-ad29-8f6bf4af4b92 service nova] Acquiring lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a9dc045c-f069-4ac2-a231-4eb3e456f9e6 req-aad92d11-4fa6-420d-ad29-8f6bf4af4b92 service nova] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a9dc045c-f069-4ac2-a231-4eb3e456f9e6 req-aad92d11-4fa6-420d-ad29-8f6bf4af4b92 service nova] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-a9dc045c-f069-4ac2-a231-4eb3e456f9e6 req-aad92d11-4fa6-420d-ad29-8f6bf4af4b92 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] No waiting events found dispatching network-vif-plugged-19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:32:23 user nova-compute[74658]: WARNING nova.compute.manager [req-a9dc045c-f069-4ac2-a231-4eb3e456f9e6 req-aad92d11-4fa6-420d-ad29-8f6bf4af4b92 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Received unexpected event network-vif-plugged-19d2fb15-214c-4db9-97c0-84013963d15a for instance with vm_state building and task_state spawning.
Nov 16 15:32:23 user nova-compute[74658]: INFO nova.compute.manager [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Took 5.93 seconds to build instance.
Nov 16 15:32:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9353f713-388f-4259-9817-090e65f04625 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.040s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:30 user nova-compute[74658]: INFO nova.compute.manager [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Detaching volume aca4bb17-9e64-4e65-821d-27a1cf4a77f0
Nov 16 15:32:30 user nova-compute[74658]: INFO nova.virt.block_device [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Attempting to driver detach volume aca4bb17-9e64-4e65-821d-27a1cf4a77f0 from mountpoint /dev/vdc
Nov 16 15:32:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Attempting to detach device vdc from instance f314ad85-524a-4326-bdd5-2c7c4de78690 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:32:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:32:30 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:32:30 user nova-compute[74658]:   <source dev="/dev/sdg"/>
Nov 16 15:32:30 user nova-compute[74658]:   <target dev="vdc" bus="virtio"/>
Nov 16 15:32:30 user nova-compute[74658]:   <serial>aca4bb17-9e64-4e65-821d-27a1cf4a77f0</serial>
Nov 16 15:32:30 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 15:32:30 user nova-compute[74658]: </disk>
Nov 16 15:32:30 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:32:30 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Successfully detached device vdc from instance f314ad85-524a-4326-bdd5-2c7c4de78690 from the persistent domain config.
Nov 16 15:32:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f314ad85-524a-4326-bdd5-2c7c4de78690 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:32:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:32:30 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:32:30 user nova-compute[74658]:   <source dev="/dev/sdg"/>
Nov 16 15:32:30 user nova-compute[74658]:   <target dev="vdc" bus="virtio"/>
Nov 16 15:32:30 user nova-compute[74658]:   <serial>aca4bb17-9e64-4e65-821d-27a1cf4a77f0</serial>
Nov 16 15:32:30 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 15:32:30 user nova-compute[74658]: </disk>
Nov 16 15:32:30 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:32:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:32:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "5834c073-5392-40f8-bd69-8e7b50cd42ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:38 user nova-compute[74658]: INFO nova.compute.manager [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Terminating instance
Nov 16 15:32:38 user nova-compute[74658]: DEBUG nova.compute.manager [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-0628e4e5-13c6-4c27-ba22-c208ab434e31 req-418d493d-c62f-4ee1-9bc5-faea6d6fe0d5 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Received event network-vif-unplugged-2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0628e4e5-13c6-4c27-ba22-c208ab434e31 req-418d493d-c62f-4ee1-9bc5-faea6d6fe0d5 service nova] Acquiring lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0628e4e5-13c6-4c27-ba22-c208ab434e31 req-418d493d-c62f-4ee1-9bc5-faea6d6fe0d5 service nova] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0628e4e5-13c6-4c27-ba22-c208ab434e31 req-418d493d-c62f-4ee1-9bc5-faea6d6fe0d5 service nova] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-0628e4e5-13c6-4c27-ba22-c208ab434e31 req-418d493d-c62f-4ee1-9bc5-faea6d6fe0d5 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] No waiting events found dispatching network-vif-unplugged-2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-0628e4e5-13c6-4c27-ba22-c208ab434e31 req-418d493d-c62f-4ee1-9bc5-faea6d6fe0d5 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Received event network-vif-unplugged-2194e788-132c-48bc-a46b-15b811535723 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:39 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Instance destroyed successfully.
Nov 16 15:32:39 user nova-compute[74658]: DEBUG nova.objects.instance [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'resources' on Instance uuid 5834c073-5392-40f8-bd69-8e7b50cd42ba {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-458537493',display_name='tempest-TestVolumeBootPattern-volume-backed-server-458537493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-458537493',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP04IvCYiOc30SwZSrR1Ch1Y0etfWIedgQUPmkgdcQXSkp73KTfQmWNkI7UjB5yFakwfymdG7UyOzIOxHSufcYbRkPfow9IgHTNl+4ly7jflH4yng83e2i3xKCvM2IBBQ==',key_name='tempest-keypair-420977997',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:28:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-5zgrq0x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=5834c073-5392-40f8-bd69-8e7b50cd42ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2194e788-132c-48bc-a46b-15b811535723", "address": "fa:16:3e:cc:f7:ca", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2194e788-13", "ovs_interfaceid": "2194e788-132c-48bc-a46b-15b811535723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "2194e788-132c-48bc-a46b-15b811535723", "address": "fa:16:3e:cc:f7:ca", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2194e788-13", "ovs_interfaceid": "2194e788-132c-48bc-a46b-15b811535723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f7:ca,bridge_name='br-int',has_traffic_filtering=True,id=2194e788-132c-48bc-a46b-15b811535723,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2194e788-13') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_vif [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f7:ca,bridge_name='br-int',has_traffic_filtering=True,id=2194e788-132c-48bc-a46b-15b811535723,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2194e788-13') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2194e788-13, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbaba91b-b84b-4200-a278-bad5c6b2026d) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:39 user nova-compute[74658]: INFO os_vif [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f7:ca,bridge_name='br-int',has_traffic_filtering=True,id=2194e788-132c-48bc-a46b-15b811535723,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2194e788-13')
Nov 16 15:32:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XwKTauQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:32:39 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaf2fa2-7509-4024-98b0-e171b333f24e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:32:39 user nova-compute[74658]: No targets found.
Nov 16 15:32:39 user nova-compute[74658]: iSNS:
Nov 16 15:32:39 user nova-compute[74658]: No targets found.
Nov 16 15:32:39 user nova-compute[74658]: STATIC:
Nov 16 15:32:39 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11
Nov 16 15:32:39 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:32:39 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:32:39 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0
Nov 16 15:32:39 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:32:39 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:32:39 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a
Nov 16 15:32:39 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:32:39 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:32:39 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44
Nov 16 15:32:39 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:32:39 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:32:39 user nova-compute[74658]: FIRMWARE:
Nov 16 15:32:39 user nova-compute[74658]: No targets found.
Nov 16 15:32:39 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:32:39 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:32:39 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[90671125-6ec3-43c0-af1c-77f4f914bd48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[42996d9b-40e9-410f-9deb-8c67a63d9ff9]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:32:39 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:32:39 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:32:39 user nova-compute[74658]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)
Nov 16 15:32:39 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 (non-flash)
Nov 16 15:32:39 user nova-compute[74658]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:32:39 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:32:39 user nova-compute[74658]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)
Nov 16 15:32:39 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07304f2290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11'): ({'sdd'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Removing single pathed devices sdd {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edfdf0d-2fef-40b4-a0bc-b190e98867d6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63f994c-3e28-4d5b-b856-34e45c607781]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flushing IO for device /dev/sdd {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ed46f0-8f5b-4606-be7b-bd24396f41b0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:32:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d864f6-259b-48ae-837a-7b7d9f83f349]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26162353763393334', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b34ab869', '/dev/disk/by-id/scsi-1SCST_BIOb34ab869-ab57c934e8fecb4b') {{(pid=84815) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3b6de7-ce5c-45ab-b567-d17dbfa28ee1]: (4, None) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c214f58-2bf8-457d-936b-587fc170fd7a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b4f7bb-edea-497e-854d-85dec3a7e7de]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11, portal: 172.16.0.220,3260]
Nov 16 15:32:40 user nova-compute[74658]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11, portal: 172.16.0.220,3260] successful.
Nov 16 15:32:40 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b28b487-225d-4391-a815-1de3cfb17e11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4905fdeb-3c57-4a19-95d4-6bf4e570f9b2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== disconnect_volume: return (333ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:32:40 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Deleting instance files /opt/stack/data/nova/instances/5834c073-5392-40f8-bd69-8e7b50cd42ba_del
Nov 16 15:32:40 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Deletion of /opt/stack/data/nova/instances/5834c073-5392-40f8-bd69-8e7b50cd42ba_del complete
Nov 16 15:32:40 user nova-compute[74658]: INFO nova.compute.manager [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 16 15:32:40 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:32:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:41 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:32:41 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Took 1.06 seconds to deallocate network for instance.
Nov 16 15:32:41 user nova-compute[74658]: DEBUG nova.compute.manager [req-edf693ce-08f4-4e1f-bd76-c896f090ef35 req-da1f4ab1-75d8-4050-af3e-64f3a8ac9f94 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Received event network-vif-plugged-2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:32:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-edf693ce-08f4-4e1f-bd76-c896f090ef35 req-da1f4ab1-75d8-4050-af3e-64f3a8ac9f94 service nova] Acquiring lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-edf693ce-08f4-4e1f-bd76-c896f090ef35 req-da1f4ab1-75d8-4050-af3e-64f3a8ac9f94 service nova] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-edf693ce-08f4-4e1f-bd76-c896f090ef35 req-da1f4ab1-75d8-4050-af3e-64f3a8ac9f94 service nova] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:41 user nova-compute[74658]: DEBUG nova.compute.manager [req-edf693ce-08f4-4e1f-bd76-c896f090ef35 req-da1f4ab1-75d8-4050-af3e-64f3a8ac9f94 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] No waiting events found dispatching network-vif-plugged-2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:32:41 user nova-compute[74658]: WARNING nova.compute.manager [req-edf693ce-08f4-4e1f-bd76-c896f090ef35 req-da1f4ab1-75d8-4050-af3e-64f3a8ac9f94 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Received unexpected event network-vif-plugged-2194e788-132c-48bc-a46b-15b811535723 for instance with vm_state active and task_state deleting.
Nov 16 15:32:41 user nova-compute[74658]: DEBUG nova.compute.manager [req-edf693ce-08f4-4e1f-bd76-c896f090ef35 req-da1f4ab1-75d8-4050-af3e-64f3a8ac9f94 service nova] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Received event network-vif-deleted-2194e788-132c-48bc-a46b-15b811535723 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:32:41 user nova-compute[74658]: INFO nova.compute.manager [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Took 0.70 seconds to detach 1 volumes for instance.
Nov 16 15:32:41 user nova-compute[74658]: DEBUG nova.compute.manager [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 5834c073-5392-40f8-bd69-8e7b50cd42ba] Deleting volume: 2b28b487-225d-4391-a815-1de3cfb17e11 {{(pid=74658) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 15:32:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:42 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:32:42 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:32:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:42 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Deleted allocations for instance 5834c073-5392-40f8-bd69-8e7b50cd42ba
Nov 16 15:32:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-4785b335-212f-470c-915c-dfb4ba542353 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "5834c073-5392-40f8-bd69-8e7b50cd42ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.591s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:50 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f314ad85-524a-4326-bdd5-2c7c4de78690 is timed out.
Nov 16 15:32:50 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Successfully detached device vdc from instance f314ad85-524a-4326-bdd5-2c7c4de78690 from the live domain config.
Nov 16 15:32:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtdmlQYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:32:50 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:32:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[47be400f-f0ae-41b1-8b38-893a293521e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:32:50 user nova-compute[74658]: No targets found.
Nov 16 15:32:50 user nova-compute[74658]: iSNS:
Nov 16 15:32:50 user nova-compute[74658]: No targets found.
Nov 16 15:32:50 user nova-compute[74658]: STATIC:
Nov 16 15:32:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0
Nov 16 15:32:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:32:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:32:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a
Nov 16 15:32:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:32:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:32:50 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44
Nov 16 15:32:50 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:32:50 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:32:50 user nova-compute[74658]: FIRMWARE:
Nov 16 15:32:50 user nova-compute[74658]: No targets found.
Nov 16 15:32:50 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:32:50 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:32:50 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dc0458-4ce8-4f6e-b0ba-6155072a8bbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae36807-85b5-49b3-99ef-bfa031e826b9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:32:50 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:32:50 user nova-compute[74658]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)
Nov 16 15:32:50 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:32:50 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:32:50 user nova-compute[74658]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 (non-flash)
Nov 16 15:32:50 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710142830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0'): ({'sdg'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Removing single pathed devices sdg {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2edbc4-34b3-47d0-9041-649d4c2f1e8c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae3053e-5e87-470f-ae81-af1c1e9ef7e7]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Flushing IO for device /dev/sdg {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:32:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[caab7236-f7a0-43c0-9a9a-dd7421deac83]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a16516-f9f5-4a69-84c2-fbdb0270602c]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] SCSI volumes sdg have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[870db714-c8eb-4407-a6f3-d3330d5f74e9]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ce2597-593e-47e9-8e3d-d8719fe4c858]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0, portal: 172.16.0.220,3260]
Nov 16 15:32:51 user nova-compute[74658]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0, portal: 172.16.0.220,3260] successful.
Nov 16 15:32:51 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca4bb17-9e64-4e65-821d-27a1cf4a77f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef764f86-42db-4699-8190-75976414dd22]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] <== disconnect_volume: return (303ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG nova.objects.instance [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'flavor' on Instance uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:32:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9e8df293-0dd4-4197-a3b1-678e57e0ad5d tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.667s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG nova.objects.instance [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'flavor' on Instance uuid ecc12081-92a2-47e0-a885-efd13f9b5965 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:32:55 user nova-compute[74658]: INFO nova.compute.manager [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Attaching volume b81a9893-9337-4047-a903-9bde5b2afab7 to /dev/vdb
Nov 16 15:32:55 user nova-compute[74658]: DEBUG os_brick.utils [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19ea9a5-bd30-48ab-a236-52401297fed0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d71171-f4bd-462c-94a3-77a0b0cc7890]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b09318-2907-492b-ad34-e733c6bac114]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[80073e55-3365-4b4c-b370-a44002033799]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:32:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:32:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:32:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:32:56 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:32:56 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed22de2-ae05-4e3e-9046-26b7f17307a3]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:32:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:32:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:32:56 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:32:56 user nova-compute[74658]: DEBUG os_brick.utils [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:32:56 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updating existing volume attachment record: 9c3d12e2-1529-4de2-98b4-de6c5e001a6f {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:32:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLblfzpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:33:00 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:33:00 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:33:00 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc2e39e-968a-41b6-ad97-e76928f0787a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:33:00 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81f9d84-0d48-4d98-bffe-2bf7d13215e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7] added
Nov 16 15:33:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6009ec-eed7-4954-bc5a-4847c81f9d38]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb58483-f98b-47e1-a464-6aadb9094b8c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLblfzpq {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLblfzpq" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de7ed25-f796-4607-9245-97911f4c0f17]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iLblfzpq'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[48832c16-4eee-4933-94ea-cbe4136a2531]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b830fa7-25a7-4b98-960f-a76353c2c1cc]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:33:00 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:33:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:33:00 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:33:00 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:33:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d056007b-c409-4ac9-bf44-45fe0a0a3ef2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7, portal: 172.16.0.220,3260]
Nov 16 15:33:01 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7, portal: 172.16.0.220,3260] successful.
Nov 16 15:33:01 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7acdbd3-b4af-4d29-b806-95d66f34a382]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6caa73-31ba-45db-b958-635d28db2f2f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:33:01 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:33:01 user nova-compute[74658]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:33:01 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:33:01 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:33:01 user nova-compute[74658]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:33:01 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[452b2633-27b7-4ff5-9bda-8d3b874db5f1]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:33:01 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLblfzpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquired lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'info_cache' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.base [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23264373761633431', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264373761633431', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'flavor' on Instance uuid ecc12081-92a2-47e0-a885-efd13f9b5965 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:33:02 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:33:02 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:33:02 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:33:02 user nova-compute[74658]:   <serial>b81a9893-9337-4047-a903-9bde5b2afab7</serial>
Nov 16 15:33:02 user nova-compute[74658]: </disk>
Nov 16 15:33:02 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updating instance_info_cache with network_info: [{"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Releasing lock "refresh_cache-6c8dd806-c294-40dd-a13d-63659a1d5669" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] No VIF found with MAC fa:16:3e:04:77:38, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:33:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance destroyed successfully.
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'resources' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.base [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-855420044',display_name='tempest-AttachVolumeTestJSON-server-855420044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-855420044',id=21,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0aQzQPL9O0sCZYH1ntlAkbDeS1BfXalYyPNg5mzbOT3rQ3DQzwLD0COpv3rF6yI3D5ElP0hp1r6opeP6BA0IQrQD2St0Ieh9euvcCJptTl1EjscoAuo3T+KfsTBHg0uQ==',key_name='tempest-keypair-2113042845',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-rfy50ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:31:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=6c8dd806-c294-40dd-a13d-63659a1d5669,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG os_vif [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadd946f4-de, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d70baee-9270-45b8-bad1-187cf2dbf112) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:33:02 user nova-compute[74658]: INFO os_vif [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de')
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Start _get_guest_xml network_info=[{"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.base [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:33:02 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:33:02 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.base [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-855420044',display_name='tempest-AttachVolumeTestJSON-server-855420044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-855420044',id=21,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0aQzQPL9O0sCZYH1ntlAkbDeS1BfXalYyPNg5mzbOT3rQ3DQzwLD0COpv3rF6yI3D5ElP0hp1r6opeP6BA0IQrQD2St0Ieh9euvcCJptTl1EjscoAuo3T+KfsTBHg0uQ==',key_name='tempest-keypair-2113042845',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-rfy50ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:31:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=6c8dd806-c294-40dd-a13d-63659a1d5669,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-37436f5d-694d-4531-b0f9-66c28b9bd190 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.858s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.objects.base [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:33:02 user nova-compute[74658]:   <uuid>6c8dd806-c294-40dd-a13d-63659a1d5669</uuid>
Nov 16 15:33:02 user nova-compute[74658]:   <name>instance-00000015</name>
Nov 16 15:33:02 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:33:02 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:33:02 user nova-compute[74658]:   <metadata>
Nov 16 15:33:02 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:33:02 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:33:02 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeTestJSON-server-855420044</nova:name>
Nov 16 15:33:02 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:33:02</nova:creationTime>
Nov 16 15:33:02 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:33:02 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:33:02 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:33:02 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:33:02 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:33:02 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:33:02 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:33:02 user nova-compute[74658]:       <nova:owner>
Nov 16 15:33:02 user nova-compute[74658]:         <nova:user uuid="f04b6f7159cc4358a2978e9c97aa2dfc">tempest-AttachVolumeTestJSON-1830126630-project-member</nova:user>
Nov 16 15:33:02 user nova-compute[74658]:         <nova:project uuid="634ad79271c9408da094067dd3c209d7">tempest-AttachVolumeTestJSON-1830126630</nova:project>
Nov 16 15:33:02 user nova-compute[74658]:       </nova:owner>
Nov 16 15:33:02 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:33:02 user nova-compute[74658]:       <nova:ports>
Nov 16 15:33:02 user nova-compute[74658]:         <nova:port uuid="add946f4-de44-48b9-9de4-3c76c1d1c8ae">
Nov 16 15:33:02 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 15:33:02 user nova-compute[74658]:         </nova:port>
Nov 16 15:33:02 user nova-compute[74658]:       </nova:ports>
Nov 16 15:33:02 user nova-compute[74658]:     </nova:instance>
Nov 16 15:33:02 user nova-compute[74658]:   </metadata>
Nov 16 15:33:02 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:33:02 user nova-compute[74658]:     <system>
Nov 16 15:33:02 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:33:02 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:33:02 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:33:02 user nova-compute[74658]:       <entry name="serial">6c8dd806-c294-40dd-a13d-63659a1d5669</entry>
Nov 16 15:33:02 user nova-compute[74658]:       <entry name="uuid">6c8dd806-c294-40dd-a13d-63659a1d5669</entry>
Nov 16 15:33:02 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:33:02 user nova-compute[74658]:     </system>
Nov 16 15:33:02 user nova-compute[74658]:   </sysinfo>
Nov 16 15:33:02 user nova-compute[74658]:   <os>
Nov 16 15:33:02 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:33:02 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:33:02 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:33:02 user nova-compute[74658]:   </os>
Nov 16 15:33:02 user nova-compute[74658]:   <features>
Nov 16 15:33:02 user nova-compute[74658]:     <acpi/>
Nov 16 15:33:02 user nova-compute[74658]:     <apic/>
Nov 16 15:33:02 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:33:02 user nova-compute[74658]:   </features>
Nov 16 15:33:02 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:33:02 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:33:02 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:33:02 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:33:02 user nova-compute[74658]:   </clock>
Nov 16 15:33:02 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:33:02 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:33:02 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:33:02 user nova-compute[74658]:   </cpu>
Nov 16 15:33:02 user nova-compute[74658]:   <devices>
Nov 16 15:33:02 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:33:02 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:33:02 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk"/>
Nov 16 15:33:02 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:33:02 user nova-compute[74658]:     </disk>
Nov 16 15:33:02 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:33:02 user nova-compute[74658]:       <mac address="fa:16:3e:f1:80:2c"/>
Nov 16 15:33:02 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:33:02 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:33:02 user nova-compute[74658]:       <target dev="tapadd946f4-de"/>
Nov 16 15:33:02 user nova-compute[74658]:     </interface>
Nov 16 15:33:02 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:33:02 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/console.log" append="off"/>
Nov 16 15:33:02 user nova-compute[74658]:     </serial>
Nov 16 15:33:02 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:33:02 user nova-compute[74658]:     <video>
Nov 16 15:33:02 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:33:02 user nova-compute[74658]:     </video>
Nov 16 15:33:02 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:33:02 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:33:02 user nova-compute[74658]:     </rng>
Nov 16 15:33:02 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:33:02 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:33:02 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:33:02 user nova-compute[74658]:     </memballoon>
Nov 16 15:33:02 user nova-compute[74658]:   </devices>
Nov 16 15:33:02 user nova-compute[74658]: </domain>
Nov 16 15:33:02 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG nova.objects.base [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Cannot resize image /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'migration_context' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG nova.objects.base [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Object Instance<6c8dd806-c294-40dd-a13d-63659a1d5669> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-855420044',display_name='tempest-AttachVolumeTestJSON-server-855420044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-855420044',id=21,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0aQzQPL9O0sCZYH1ntlAkbDeS1BfXalYyPNg5mzbOT3rQ3DQzwLD0COpv3rF6yI3D5ElP0hp1r6opeP6BA0IQrQD2St0Ieh9euvcCJptTl1EjscoAuo3T+KfsTBHg0uQ==',key_name='tempest-keypair-2113042845',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-rfy50ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:31:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=6c8dd806-c294-40dd-a13d-63659a1d5669,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG os_vif [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1187be47-9485-5392-b79b-0f1793077c8d', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadd946f4-de, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadd946f4-de, col_values=(('qos', UUID('9b655bad-c9e8-44cc-8960-2e02947e9675')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadd946f4-de, col_values=(('external_ids', {'iface-id': 'add946f4-de44-48b9-9de4-3c76c1d1c8ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:80:2c', 'vm-uuid': '6c8dd806-c294-40dd-a13d-63659a1d5669'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:33:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:03 user nova-compute[74658]: INFO os_vif [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de')
Nov 16 15:33:04 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-7049bf23-5b3b-4077-9ec8-f3bf44295311 req-d72121f9-f53b-4aab-8838-21a1a8790c0b service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-changed-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-7049bf23-5b3b-4077-9ec8-f3bf44295311 req-d72121f9-f53b-4aab-8838-21a1a8790c0b service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Refreshing instance network info cache due to event network-changed-8845dcec-73a4-4fbc-a835-88ced3593d56. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7049bf23-5b3b-4077-9ec8-f3bf44295311 req-d72121f9-f53b-4aab-8838-21a1a8790c0b service nova] Acquiring lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7049bf23-5b3b-4077-9ec8-f3bf44295311 req-d72121f9-f53b-4aab-8838-21a1a8790c0b service nova] Acquired lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG nova.network.neutron [req-7049bf23-5b3b-4077-9ec8-f3bf44295311 req-d72121f9-f53b-4aab-8838-21a1a8790c0b service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Refreshing network info cache for port 8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-8cdf119d-a082-4dc9-a49f-aa8deb7475cc req-37e1b44a-5382-4080-b076-d683854fea6d service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8cdf119d-a082-4dc9-a49f-aa8deb7475cc req-37e1b44a-5382-4080-b076-d683854fea6d service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8cdf119d-a082-4dc9-a49f-aa8deb7475cc req-37e1b44a-5382-4080-b076-d683854fea6d service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8cdf119d-a082-4dc9-a49f-aa8deb7475cc req-37e1b44a-5382-4080-b076-d683854fea6d service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-8cdf119d-a082-4dc9-a49f-aa8deb7475cc req-37e1b44a-5382-4080-b076-d683854fea6d service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:05 user nova-compute[74658]: WARNING nova.compute.manager [req-8cdf119d-a082-4dc9-a49f-aa8deb7475cc req-37e1b44a-5382-4080-b076-d683854fea6d service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received unexpected event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with vm_state stopped and task_state powering-on.
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG nova.network.neutron [req-7049bf23-5b3b-4077-9ec8-f3bf44295311 req-d72121f9-f53b-4aab-8838-21a1a8790c0b service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updated VIF entry in instance network info cache for port 8845dcec-73a4-4fbc-a835-88ced3593d56. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG nova.network.neutron [req-7049bf23-5b3b-4077-9ec8-f3bf44295311 req-d72121f9-f53b-4aab-8838-21a1a8790c0b service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updating instance_info_cache with network_info: [{"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7049bf23-5b3b-4077-9ec8-f3bf44295311 req-d72121f9-f53b-4aab-8838-21a1a8790c0b service nova] Releasing lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:33:07 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance rebooted successfully.
Nov 16 15:33:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2d682c22-cb82-459c-92a9-9a9148ba3209 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-b391c353-ea82-4ae0-9c1e-df9ea95cf53e req-2821d765-46a5-42b2-a22a-65f6e95fa511 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b391c353-ea82-4ae0-9c1e-df9ea95cf53e req-2821d765-46a5-42b2-a22a-65f6e95fa511 service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b391c353-ea82-4ae0-9c1e-df9ea95cf53e req-2821d765-46a5-42b2-a22a-65f6e95fa511 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b391c353-ea82-4ae0-9c1e-df9ea95cf53e req-2821d765-46a5-42b2-a22a-65f6e95fa511 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-b391c353-ea82-4ae0-9c1e-df9ea95cf53e req-2821d765-46a5-42b2-a22a-65f6e95fa511 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:07 user nova-compute[74658]: WARNING nova.compute.manager [req-b391c353-ea82-4ae0-9c1e-df9ea95cf53e req-2821d765-46a5-42b2-a22a-65f6e95fa511 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received unexpected event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with vm_state active and task_state None.
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:08 user nova-compute[74658]: INFO nova.compute.manager [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Rebooting instance
Nov 16 15:33:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquired lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:08 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:33:08 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=25.14211654663086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6c8dd806-c294-40dd-a13d-63659a1d5669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 97135af5-e020-482b-a54b-6cf30a5443d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance b6a0ca45-19d0-4644-8e65-fe904d85e1c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 67d2aeee-7218-4e85-baa3-157643a4301e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance f314ad85-524a-4326-bdd5-2c7c4de78690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ecc12081-92a2-47e0-a885-efd13f9b5965 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updating instance_info_cache with network_info: [{"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Releasing lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:33:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-a19a9f79-a1f4-4260-93c2-55acf1bcc910 req-ad2b1b71-9046-4eb1-a146-a0aee6df2ce7 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-changed-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-a19a9f79-a1f4-4260-93c2-55acf1bcc910 req-ad2b1b71-9046-4eb1-a146-a0aee6df2ce7 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Refreshing instance network info cache due to event network-changed-8845dcec-73a4-4fbc-a835-88ced3593d56. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a19a9f79-a1f4-4260-93c2-55acf1bcc910 req-ad2b1b71-9046-4eb1-a146-a0aee6df2ce7 service nova] Acquiring lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a19a9f79-a1f4-4260-93c2-55acf1bcc910 req-ad2b1b71-9046-4eb1-a146-a0aee6df2ce7 service nova] Acquired lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG nova.network.neutron [req-a19a9f79-a1f4-4260-93c2-55acf1bcc910 req-ad2b1b71-9046-4eb1-a146-a0aee6df2ce7 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Refreshing network info cache for port 8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG nova.network.neutron [req-a19a9f79-a1f4-4260-93c2-55acf1bcc910 req-ad2b1b71-9046-4eb1-a146-a0aee6df2ce7 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updated VIF entry in instance network info cache for port 8845dcec-73a4-4fbc-a835-88ced3593d56. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG nova.network.neutron [req-a19a9f79-a1f4-4260-93c2-55acf1bcc910 req-ad2b1b71-9046-4eb1-a146-a0aee6df2ce7 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updating instance_info_cache with network_info: [{"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:33:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a19a9f79-a1f4-4260-93c2-55acf1bcc910 req-ad2b1b71-9046-4eb1-a146-a0aee6df2ce7 service nova] Releasing lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Updating instance_info_cache with network_info: [{"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-b6a0ca45-19d0-4644-8e65-fe904d85e1c1" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:33:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-d73c0156-15e9-4ad8-aec2-c8adbbca662a req-86861b3a-babf-4fec-917b-096dd21ae71a service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-vif-unplugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d73c0156-15e9-4ad8-aec2-c8adbbca662a req-86861b3a-babf-4fec-917b-096dd21ae71a service nova] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d73c0156-15e9-4ad8-aec2-c8adbbca662a req-86861b3a-babf-4fec-917b-096dd21ae71a service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d73c0156-15e9-4ad8-aec2-c8adbbca662a req-86861b3a-babf-4fec-917b-096dd21ae71a service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-d73c0156-15e9-4ad8-aec2-c8adbbca662a req-86861b3a-babf-4fec-917b-096dd21ae71a service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] No waiting events found dispatching network-vif-unplugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:11 user nova-compute[74658]: WARNING nova.compute.manager [req-d73c0156-15e9-4ad8-aec2-c8adbbca662a req-86861b3a-babf-4fec-917b-096dd21ae71a service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received unexpected event network-vif-unplugged-8845dcec-73a4-4fbc-a835-88ced3593d56 for instance with vm_state active and task_state reboot_started.
Nov 16 15:33:12 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Instance shutdown successfully.
Nov 16 15:33:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-860395ba-3884-46e2-bbd0-b40e72420c98 req-22cf83a9-c78c-4f12-b0fe-86f38b012782 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-860395ba-3884-46e2-bbd0-b40e72420c98 req-22cf83a9-c78c-4f12-b0fe-86f38b012782 service nova] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-860395ba-3884-46e2-bbd0-b40e72420c98 req-22cf83a9-c78c-4f12-b0fe-86f38b012782 service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-860395ba-3884-46e2-bbd0-b40e72420c98 req-22cf83a9-c78c-4f12-b0fe-86f38b012782 service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-860395ba-3884-46e2-bbd0-b40e72420c98 req-22cf83a9-c78c-4f12-b0fe-86f38b012782 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] No waiting events found dispatching network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:13 user nova-compute[74658]: WARNING nova.compute.manager [req-860395ba-3884-46e2-bbd0-b40e72420c98 req-22cf83a9-c78c-4f12-b0fe-86f38b012782 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received unexpected event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 for instance with vm_state active and task_state reboot_started.
Nov 16 15:33:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:14 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:15 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Instance running successfully.
Nov 16 15:33:15 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Instance soft rebooted successfully.
Nov 16 15:33:15 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1ecb395d-404a-469a-a6a8-96221e5c2ec8 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.427s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] No waiting events found dispatching network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:15 user nova-compute[74658]: WARNING nova.compute.manager [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received unexpected event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 for instance with vm_state active and task_state None.
Nov 16 15:33:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] No waiting events found dispatching network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:15 user nova-compute[74658]: WARNING nova.compute.manager [req-4e3e930e-fb1c-4a95-bfff-c6a37d145f06 req-b4b6d892-7a27-4921-a30b-50089c3b260a service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received unexpected event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 for instance with vm_state active and task_state None.
Nov 16 15:33:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_power_states {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 7ef751d1-099a-4b46-b08d-99929d449ef9 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 766f2096-3fe3-4d6f-93cd-2a07c8967197 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 97135af5-e020-482b-a54b-6cf30a5443d4 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid b6a0ca45-19d0-4644-8e65-fe904d85e1c1 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 67d2aeee-7218-4e85-baa3-157643a4301e {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid ecc12081-92a2-47e0-a885-efd13f9b5965 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "7ef751d1-099a-4b46-b08d-99929d449ef9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "97135af5-e020-482b-a54b-6cf30a5443d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "97135af5-e020-482b-a54b-6cf30a5443d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "67d2aeee-7218-4e85-baa3-157643a4301e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "67d2aeee-7218-4e85-baa3-157643a4301e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "97135af5-e020-482b-a54b-6cf30a5443d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:20 user nova-compute[74658]: INFO nova.compute.manager [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Terminating instance
Nov 16 15:33:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e4fa480-af71-4792-87d3-40da3b96f1f8 req-eca9504a-55c5-4a1a-87ff-31c198ba2c42 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-vif-unplugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e4fa480-af71-4792-87d3-40da3b96f1f8 req-eca9504a-55c5-4a1a-87ff-31c198ba2c42 service nova] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e4fa480-af71-4792-87d3-40da3b96f1f8 req-eca9504a-55c5-4a1a-87ff-31c198ba2c42 service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9e4fa480-af71-4792-87d3-40da3b96f1f8 req-eca9504a-55c5-4a1a-87ff-31c198ba2c42 service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e4fa480-af71-4792-87d3-40da3b96f1f8 req-eca9504a-55c5-4a1a-87ff-31c198ba2c42 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] No waiting events found dispatching network-vif-unplugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-9e4fa480-af71-4792-87d3-40da3b96f1f8 req-eca9504a-55c5-4a1a-87ff-31c198ba2c42 service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-vif-unplugged-1aaa65c9-53cf-439c-89b1-90afbc230119 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:33:21 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Instance destroyed successfully.
Nov 16 15:33:21 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'resources' on Instance uuid f314ad85-524a-4326-bdd5-2c7c4de78690 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-909763891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-909763891',id=26,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6B2As6euHF6EOU2uQ2X/k5aA2RDKadyeTUrxMV8YTOQg0RBAAjU0lxyCB4onxqpvWrFnYJxo2/4tL7xWFO5wkc//rQaHy6VMnvx+fev8tC2XpCVog5oIo0Mep1avUsKA==',key_name='tempest-keypair-876002203',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-m5jl5mv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=f314ad85-524a-4326-bdd5-2c7c4de78690,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "1aaa65c9-53cf-439c-89b1-90afbc230119", "address": "fa:16:3e:48:6b:ed", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaa65c9-53", "ovs_interfaceid": "1aaa65c9-53cf-439c-89b1-90afbc230119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG os_vif [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aaa65c9-53, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66da7025-f803-4304-b716-2ba283ee6e61) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:21 user nova-compute[74658]: INFO os_vif [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1aaa65c9-53cf-439c-89b1-90afbc230119,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaa65c9-53')
Nov 16 15:33:21 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Deleting instance files /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690_del
Nov 16 15:33:21 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Deletion of /opt/stack/data/nova/instances/f314ad85-524a-4326-bdd5-2c7c4de78690_del complete
Nov 16 15:33:21 user nova-compute[74658]: INFO nova.compute.manager [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 15:33:21 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:33:21 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:33:22 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:33:22 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Took 0.70 seconds to deallocate network for instance.
Nov 16 15:33:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-bcc6a0de-7bf8-4806-8525-33683aea1a1c req-7ab9edc2-1b96-42a4-a385-2acd1c218ecd service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-vif-deleted-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:22 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:33:22 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:33:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:22 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Deleted allocations for instance f314ad85-524a-4326-bdd5-2c7c4de78690
Nov 16 15:33:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0e74dc33-371a-4d07-8035-a3c6d19c1ba2 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-a799f4ec-4c8e-4829-8ea9-85b035c42e36 req-38c23eed-6b8c-438b-bbf1-3bdf8c1a449e service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a799f4ec-4c8e-4829-8ea9-85b035c42e36 req-38c23eed-6b8c-438b-bbf1-3bdf8c1a449e service nova] Acquiring lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a799f4ec-4c8e-4829-8ea9-85b035c42e36 req-38c23eed-6b8c-438b-bbf1-3bdf8c1a449e service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a799f4ec-4c8e-4829-8ea9-85b035c42e36 req-38c23eed-6b8c-438b-bbf1-3bdf8c1a449e service nova] Lock "f314ad85-524a-4326-bdd5-2c7c4de78690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-a799f4ec-4c8e-4829-8ea9-85b035c42e36 req-38c23eed-6b8c-438b-bbf1-3bdf8c1a449e service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] No waiting events found dispatching network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:23 user nova-compute[74658]: WARNING nova.compute.manager [req-a799f4ec-4c8e-4829-8ea9-85b035c42e36 req-38c23eed-6b8c-438b-bbf1-3bdf8c1a449e service nova] [instance: f314ad85-524a-4326-bdd5-2c7c4de78690] Received unexpected event network-vif-plugged-1aaa65c9-53cf-439c-89b1-90afbc230119 for instance with vm_state deleted and task_state None.
Nov 16 15:33:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "aa513122-cec4-4659-9827-6578827018aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "aa513122-cec4-4659-9827-6578827018aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:33:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:37 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:33:37 user nova-compute[74658]: INFO nova.compute.claims [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Claim successful on node user
Nov 16 15:33:38 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG nova.compute.manager [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG nova.compute.manager [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG nova.network.neutron [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:33:38 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:33:38 user nova-compute[74658]: DEBUG nova.compute.manager [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG nova.policy [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aed7ea9505b3400ebbe1ce456419bc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2156886e7c2247e38a1ffe4025798a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:33:38 user nova-compute[74658]: INFO nova.virt.block_device [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Booting with volume 35afd958-7ad4-4133-8bfa-bfccac228014 at /dev/vda
Nov 16 15:33:38 user nova-compute[74658]: DEBUG os_brick.utils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[453b4dc6-5a3a-41cf-b97b-75f718feb7ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bbbe8d-7070-4d26-bcbf-ab31834fd832]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7ec5e8-8d5b-49e3-b5d2-3670670de11a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ac4ebc-7078-4580-b278-547378227788]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:33:38 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:33:38 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2eecd8-9f74-41ec-a6c6-6daf355ef72f]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG os_brick.utils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Updating existing volume attachment record: 55e60641-3ade-4489-ab9f-4295b11e57c4 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:33:38 user nova-compute[74658]: DEBUG nova.network.neutron [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Successfully created port: c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:33:39 user nova-compute[74658]: DEBUG nova.network.neutron [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Successfully updated port: c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:33:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "refresh_cache-aa513122-cec4-4659-9827-6578827018aa" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:33:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquired lock "refresh_cache-aa513122-cec4-4659-9827-6578827018aa" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:33:39 user nova-compute[74658]: DEBUG nova.network.neutron [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:33:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-05b8c093-bd4f-4ee1-982f-7c3773a117a9 req-d779af02-d8d8-4f98-a632-607f130e73dc service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Received event network-changed-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-05b8c093-bd4f-4ee1-982f-7c3773a117a9 req-d779af02-d8d8-4f98-a632-607f130e73dc service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Refreshing instance network info cache due to event network-changed-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:33:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-05b8c093-bd4f-4ee1-982f-7c3773a117a9 req-d779af02-d8d8-4f98-a632-607f130e73dc service nova] Acquiring lock "refresh_cache-aa513122-cec4-4659-9827-6578827018aa" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:33:39 user nova-compute[74658]: DEBUG nova.network.neutron [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:33:40 user nova-compute[74658]: DEBUG nova.network.neutron [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Updating instance_info_cache with network_info: [{"id": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "address": "fa:16:3e:39:bc:a2", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1acc58b-3c", "ovs_interfaceid": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:33:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Releasing lock "refresh_cache-aa513122-cec4-4659-9827-6578827018aa" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:33:40 user nova-compute[74658]: DEBUG nova.compute.manager [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Instance network_info: |[{"id": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "address": "fa:16:3e:39:bc:a2", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1acc58b-3c", "ovs_interfaceid": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:33:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-05b8c093-bd4f-4ee1-982f-7c3773a117a9 req-d779af02-d8d8-4f98-a632-607f130e73dc service nova] Acquired lock "refresh_cache-aa513122-cec4-4659-9827-6578827018aa" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:33:40 user nova-compute[74658]: DEBUG nova.network.neutron [req-05b8c093-bd4f-4ee1-982f-7c3773a117a9 req-d779af02-d8d8-4f98-a632-607f130e73dc service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Refreshing network info cache for port c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:33:40 user nova-compute[74658]: DEBUG nova.network.neutron [req-05b8c093-bd4f-4ee1-982f-7c3773a117a9 req-d779af02-d8d8-4f98-a632-607f130e73dc service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Updated VIF entry in instance network info cache for port c1acc58b-3c96-4d93-bb7c-0d6c55115b1a. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:33:40 user nova-compute[74658]: DEBUG nova.network.neutron [req-05b8c093-bd4f-4ee1-982f-7c3773a117a9 req-d779af02-d8d8-4f98-a632-607f130e73dc service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Updating instance_info_cache with network_info: [{"id": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "address": "fa:16:3e:39:bc:a2", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1acc58b-3c", "ovs_interfaceid": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:33:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-05b8c093-bd4f-4ee1-982f-7c3773a117a9 req-d779af02-d8d8-4f98-a632-607f130e73dc service nova] Releasing lock "refresh_cache-aa513122-cec4-4659-9827-6578827018aa" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:33:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:42 user nova-compute[74658]: INFO nova.compute.manager [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Terminating instance
Nov 16 15:33:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:33:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-4bd34388-9d61-47b3-bbdd-137312bcac39 req-58cee6c5-1a99-42a6-88d7-c95d57c94152 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-unplugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4bd34388-9d61-47b3-bbdd-137312bcac39 req-58cee6c5-1a99-42a6-88d7-c95d57c94152 service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4bd34388-9d61-47b3-bbdd-137312bcac39 req-58cee6c5-1a99-42a6-88d7-c95d57c94152 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4bd34388-9d61-47b3-bbdd-137312bcac39 req-58cee6c5-1a99-42a6-88d7-c95d57c94152 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-4bd34388-9d61-47b3-bbdd-137312bcac39 req-58cee6c5-1a99-42a6-88d7-c95d57c94152 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-unplugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-4bd34388-9d61-47b3-bbdd-137312bcac39 req-58cee6c5-1a99-42a6-88d7-c95d57c94152 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-unplugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.compute.manager [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:33:43 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Creating image(s)
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Ensure instance console log exists: /opt/stack/data/nova/instances/aa513122-cec4-4659-9827-6578827018aa/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Start _get_guest_xml network_info=[{"id": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "address": "fa:16:3e:39:bc:a2", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1acc58b-3c", "ovs_interfaceid": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '55e60641-3ade-4489-ab9f-4295b11e57c4', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJDPvkmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa513122-cec4-4659-9827-6578827018aa', 'attached_at': '', 'detached_at': '', 'volume_id': '35afd958-7ad4-4133-8bfa-bfccac228014', 'serial': '35afd958-7ad4-4133-8bfa-bfccac228014'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:33:43 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:33:43 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJDPvkmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:33:43 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:33:43 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:33:43 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4bdf96-bbfe-4ffd-9686-b64b4da9a78e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:33:43 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:43 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Instance destroyed successfully.
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.objects.instance [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'resources' on Instance uuid b6a0ca45-19d0-4644-8e65-fe904d85e1c1 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2014300948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2014300948',id=28,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:30:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='621284eebf704320bacac96aedbc77a4',ramdisk_id='',reservation_id='r-ttx4gd15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:31:57Z,user_data=None,user_id='6ed5db501b2e4dcfb742e18dfdeae88b',uuid=b6a0ca45-19d0-4644-8e65-fe904d85e1c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converting VIF {"id": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "address": "fa:16:3e:4d:7d:8d", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c165cd-1a", "ovs_interfaceid": "54c165cd-1a44-4017-9b20-e2d1ebc02101", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=54c165cd-1a44-4017-9b20-e2d1ebc02101,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c165cd-1a') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_vif [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=54c165cd-1a44-4017-9b20-e2d1ebc02101,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c165cd-1a') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f9c2f2-bd6e-4efc-adc5-e253a4623bac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014] added
Nov 16 15:33:43 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54c165cd-1a, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8806aacc-3592-4544-ba20-b3f49849a650) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:43 user nova-compute[74658]: INFO os_vif [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=54c165cd-1a44-4017-9b20-e2d1ebc02101,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c165cd-1a')
Nov 16 15:33:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhZyDBUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:33:43 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[769bf457-292b-4ad1-aa89-f62aea0b72bb]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b6ec5c-c7f9-45c8-88d3-62295899b1d8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJDPvkmV {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJDPvkmV" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[12531eab-6fab-4343-9893-aa0e00c4b5f0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FJDPvkmV'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7964e745-2637-46dc-9871-20fca20c6772]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[475a1f7a-f0ca-40d6-b55f-b44087003054]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:33:43 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:33:43 user nova-compute[74658]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:33:43 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:33:43 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:33:43 user nova-compute[74658]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:33:43 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfff28dd-5aaa-4e54-a97c-19076e9343c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260]
Nov 16 15:33:43 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260] successful.
Nov 16 15:33:43 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5346ef0-1da9-481f-9ad7-702fe4ee5e0f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b342a9-62d4-4ca7-912f-3522e1b0a25d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:33:43 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:33:43 user nova-compute[74658]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:33:43 user nova-compute[74658]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:33:43 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:33:43 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:33:43 user nova-compute[74658]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:33:43 user nova-compute[74658]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:33:43 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[551e3373-d923-4317-8597-12a00c870bac]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:33:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJDPvkmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23238616332383661', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238616332383661', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.256s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-471800252',display_name='tempest-TestVolumeBootPattern-server-471800252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-471800252',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa3gqCorV1WbIg5i//0wnlopR+3KlyeNwvcR7SHxTAoz1md6ZPUq6Nr5c+6nYZB4Ns6g0kjBKvILHRe+adcrSzLJ8v98clK+l5Pw4QpWw7oSlS+Kt7nCSty+cuvnOaubg==',key_name='tempest-TestVolumeBootPattern-1945158636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-rcvuz3c4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:33:38Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=aa513122-cec4-4659-9827-6578827018aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "address": "fa:16:3e:39:bc:a2", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1acc58b-3c", "ovs_interfaceid": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "address": "fa:16:3e:39:bc:a2", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1acc58b-3c", "ovs_interfaceid": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:bc:a2,bridge_name='br-int',has_traffic_filtering=True,id=c1acc58b-3c96-4d93-bb7c-0d6c55115b1a,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1acc58b-3c') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG nova.objects.instance [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'pci_devices' on Instance uuid aa513122-cec4-4659-9827-6578827018aa {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c6fdb8-e175-4047-b279-b17b6ac86efc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:33:44 user nova-compute[74658]: No targets found.
Nov 16 15:33:44 user nova-compute[74658]: iSNS:
Nov 16 15:33:44 user nova-compute[74658]: No targets found.
Nov 16 15:33:44 user nova-compute[74658]: STATIC:
Nov 16 15:33:44 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7
Nov 16 15:33:44 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:33:44 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:33:44 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a
Nov 16 15:33:44 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:33:44 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:33:44 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014
Nov 16 15:33:44 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:33:44 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:33:44 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44
Nov 16 15:33:44 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:33:44 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:33:44 user nova-compute[74658]: FIRMWARE:
Nov 16 15:33:44 user nova-compute[74658]: No targets found.
Nov 16 15:33:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:33:44 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:33:44 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:33:44 user nova-compute[74658]:   <uuid>aa513122-cec4-4659-9827-6578827018aa</uuid>
Nov 16 15:33:44 user nova-compute[74658]:   <name>instance-00000022</name>
Nov 16 15:33:44 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:33:44 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:33:44 user nova-compute[74658]:   <metadata>
Nov 16 15:33:44 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:33:44 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:33:44 user nova-compute[74658]:       <nova:name>tempest-TestVolumeBootPattern-server-471800252</nova:name>
Nov 16 15:33:44 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:33:43</nova:creationTime>
Nov 16 15:33:44 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:33:44 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:33:44 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:33:44 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:33:44 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:33:44 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:33:44 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:33:44 user nova-compute[74658]:       <nova:owner>
Nov 16 15:33:44 user nova-compute[74658]:         <nova:user uuid="aed7ea9505b3400ebbe1ce456419bc82">tempest-TestVolumeBootPattern-1853010836-project-member</nova:user>
Nov 16 15:33:44 user nova-compute[74658]:         <nova:project uuid="2156886e7c2247e38a1ffe4025798a96">tempest-TestVolumeBootPattern-1853010836</nova:project>
Nov 16 15:33:44 user nova-compute[74658]:       </nova:owner>
Nov 16 15:33:44 user nova-compute[74658]:       <nova:ports>
Nov 16 15:33:44 user nova-compute[74658]:         <nova:port uuid="c1acc58b-3c96-4d93-bb7c-0d6c55115b1a">
Nov 16 15:33:44 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 15:33:44 user nova-compute[74658]:         </nova:port>
Nov 16 15:33:44 user nova-compute[74658]:       </nova:ports>
Nov 16 15:33:44 user nova-compute[74658]:     </nova:instance>
Nov 16 15:33:44 user nova-compute[74658]:   </metadata>
Nov 16 15:33:44 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:33:44 user nova-compute[74658]:     <system>
Nov 16 15:33:44 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:33:44 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:33:44 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:33:44 user nova-compute[74658]:       <entry name="serial">aa513122-cec4-4659-9827-6578827018aa</entry>
Nov 16 15:33:44 user nova-compute[74658]:       <entry name="uuid">aa513122-cec4-4659-9827-6578827018aa</entry>
Nov 16 15:33:44 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:33:44 user nova-compute[74658]:     </system>
Nov 16 15:33:44 user nova-compute[74658]:   </sysinfo>
Nov 16 15:33:44 user nova-compute[74658]:   <os>
Nov 16 15:33:44 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:33:44 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:33:44 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:33:44 user nova-compute[74658]:   </os>
Nov 16 15:33:44 user nova-compute[74658]:   <features>
Nov 16 15:33:44 user nova-compute[74658]:     <acpi/>
Nov 16 15:33:44 user nova-compute[74658]:     <apic/>
Nov 16 15:33:44 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:33:44 user nova-compute[74658]:   </features>
Nov 16 15:33:44 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:33:44 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:33:44 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:33:44 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:33:44 user nova-compute[74658]:   </clock>
Nov 16 15:33:44 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:33:44 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:33:44 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:33:44 user nova-compute[74658]:   </cpu>
Nov 16 15:33:44 user nova-compute[74658]:   <devices>
Nov 16 15:33:44 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:33:44 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:33:44 user nova-compute[74658]:       <source dev="/dev/sdc"/>
Nov 16 15:33:44 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:33:44 user nova-compute[74658]:       <serial>35afd958-7ad4-4133-8bfa-bfccac228014</serial>
Nov 16 15:33:44 user nova-compute[74658]:     </disk>
Nov 16 15:33:44 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:33:44 user nova-compute[74658]:       <mac address="fa:16:3e:39:bc:a2"/>
Nov 16 15:33:44 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:33:44 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:33:44 user nova-compute[74658]:       <target dev="tapc1acc58b-3c"/>
Nov 16 15:33:44 user nova-compute[74658]:     </interface>
Nov 16 15:33:44 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:33:44 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/aa513122-cec4-4659-9827-6578827018aa/console.log" append="off"/>
Nov 16 15:33:44 user nova-compute[74658]:     </serial>
Nov 16 15:33:44 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:33:44 user nova-compute[74658]:     <video>
Nov 16 15:33:44 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:33:44 user nova-compute[74658]:     </video>
Nov 16 15:33:44 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:33:44 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:33:44 user nova-compute[74658]:     </rng>
Nov 16 15:33:44 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:33:44 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:33:44 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:33:44 user nova-compute[74658]:     </memballoon>
Nov 16 15:33:44 user nova-compute[74658]:   </devices>
Nov 16 15:33:44 user nova-compute[74658]: </domain>
Nov 16 15:33:44 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-471800252',display_name='tempest-TestVolumeBootPattern-server-471800252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-471800252',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa3gqCorV1WbIg5i//0wnlopR+3KlyeNwvcR7SHxTAoz1md6ZPUq6Nr5c+6nYZB4Ns6g0kjBKvILHRe+adcrSzLJ8v98clK+l5Pw4QpWw7oSlS+Kt7nCSty+cuvnOaubg==',key_name='tempest-TestVolumeBootPattern-1945158636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-rcvuz3c4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:33:38Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=aa513122-cec4-4659-9827-6578827018aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "address": "fa:16:3e:39:bc:a2", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1acc58b-3c", "ovs_interfaceid": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "address": "fa:16:3e:39:bc:a2", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1acc58b-3c", "ovs_interfaceid": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:bc:a2,bridge_name='br-int',has_traffic_filtering=True,id=c1acc58b-3c96-4d93-bb7c-0d6c55115b1a,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1acc58b-3c') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_vif [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:bc:a2,bridge_name='br-int',has_traffic_filtering=True,id=c1acc58b-3c96-4d93-bb7c-0d6c55115b1a,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1acc58b-3c') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e752e98-ffe6-5b51-9bb7-a31caec73cd1', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[064ade9d-c231-4cf2-ac63-3700df9e6d38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1acc58b-3c, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1acc58b-3c, col_values=(('qos', UUID('4875d5d2-2fe8-41eb-b317-85108c758ce4')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1acc58b-3c, col_values=(('external_ids', {'iface-id': 'c1acc58b-3c96-4d93-bb7c-0d6c55115b1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:bc:a2', 'vm-uuid': 'aa513122-cec4-4659-9827-6578827018aa'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:44 user nova-compute[74658]: INFO os_vif [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:bc:a2,bridge_name='br-int',has_traffic_filtering=True,id=c1acc58b-3c96-4d93-bb7c-0d6c55115b1a,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1acc58b-3c')
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a904549f-64ee-4c6f-bf0b-2c319c94bb2b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:33:44 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:33:44 user nova-compute[74658]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:33:44 user nova-compute[74658]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:33:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 (non-flash)
Nov 16 15:33:44 user nova-compute[74658]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:33:44 user nova-compute[74658]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:33:44 user nova-compute[74658]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:33:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06f0623c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44'): ({'sde'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Removing single pathed devices sde {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc84fd2-ac40-495c-a17f-a79307f3615c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No VIF found with MAC fa:16:3e:39:bc:a2, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3783c67f-7097-4bb8-b24d-e3f72604424b]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Flushing IO for device /dev/sde {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d35ebf-f2c3-46b5-a922-ba010def4e23]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:33:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[419af25c-e779-43fb-b017-277578615566]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] SCSI volumes sde have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd12bf26-1757-495c-9479-47d015d8b8fb]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[73548896-e5e6-4956-966f-e1ebe1c0d84e]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44, portal: 172.16.0.220,3260]
Nov 16 15:33:45 user nova-compute[74658]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44, portal: 172.16.0.220,3260] successful.
Nov 16 15:33:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-3327b6e9-a91b-4a25-bce0-abc3bb3f3384 req-63aafefd-4b71-4fd1-bacd-4e1323b50941 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3327b6e9-a91b-4a25-bce0-abc3bb3f3384 req-63aafefd-4b71-4fd1-bacd-4e1323b50941 service nova] Acquiring lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3327b6e9-a91b-4a25-bce0-abc3bb3f3384 req-63aafefd-4b71-4fd1-bacd-4e1323b50941 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3327b6e9-a91b-4a25-bce0-abc3bb3f3384 req-63aafefd-4b71-4fd1-bacd-4e1323b50941 service nova] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-3327b6e9-a91b-4a25-bce0-abc3bb3f3384 req-63aafefd-4b71-4fd1-bacd-4e1323b50941 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] No waiting events found dispatching network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:45 user nova-compute[74658]: WARNING nova.compute.manager [req-3327b6e9-a91b-4a25-bce0-abc3bb3f3384 req-63aafefd-4b71-4fd1-bacd-4e1323b50941 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received unexpected event network-vif-plugged-54c165cd-1a44-4017-9b20-e2d1ebc02101 for instance with vm_state active and task_state deleting.
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5443b744-0bfd-453d-b6e9-c4a54605cb44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad8dbab-18ce-4b65-b1dc-2a5956263871]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] <== disconnect_volume: return (1598ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:33:45 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Deleting instance files /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1_del
Nov 16 15:33:45 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Deletion of /opt/stack/data/nova/instances/b6a0ca45-19d0-4644-8e65-fe904d85e1c1_del complete
Nov 16 15:33:45 user nova-compute[74658]: INFO nova.compute.manager [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Took 2.44 seconds to destroy the instance on the hypervisor.
Nov 16 15:33:45 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:33:45 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Took 0.41 seconds to deallocate network for instance.
Nov 16 15:33:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-afb5ce83-9d6e-41e4-9f38-e1ed0c6e2190 req-d596114b-e818-498b-a5a9-d5b48f78ed07 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Received event network-vif-deleted-54c165cd-1a44-4017-9b20-e2d1ebc02101 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:45 user nova-compute[74658]: INFO nova.compute.manager [req-afb5ce83-9d6e-41e4-9f38-e1ed0c6e2190 req-d596114b-e818-498b-a5a9-d5b48f78ed07 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Neutron deleted interface 54c165cd-1a44-4017-9b20-e2d1ebc02101; detaching it from the instance and deleting it from the info cache
Nov 16 15:33:45 user nova-compute[74658]: DEBUG nova.network.neutron [req-afb5ce83-9d6e-41e4-9f38-e1ed0c6e2190 req-d596114b-e818-498b-a5a9-d5b48f78ed07 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:33:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-afb5ce83-9d6e-41e4-9f38-e1ed0c6e2190 req-d596114b-e818-498b-a5a9-d5b48f78ed07 service nova] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Detach interface failed, port_id=54c165cd-1a44-4017-9b20-e2d1ebc02101, reason: Instance b6a0ca45-19d0-4644-8e65-fe904d85e1c1 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:33:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:46 user nova-compute[74658]: INFO nova.compute.manager [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: b6a0ca45-19d0-4644-8e65-fe904d85e1c1] Took 0.77 seconds to detach 1 volumes for instance.
Nov 16 15:33:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:46 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:33:46 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:33:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:46 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Deleted allocations for instance b6a0ca45-19d0-4644-8e65-fe904d85e1c1
Nov 16 15:33:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-60661c5c-2a67-46ee-bb9c-a2763c9e6149 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "b6a0ca45-19d0-4644-8e65-fe904d85e1c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.120s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Received event network-vif-plugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] Acquiring lock "aa513122-cec4-4659-9827-6578827018aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] Lock "aa513122-cec4-4659-9827-6578827018aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] Lock "aa513122-cec4-4659-9827-6578827018aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] No waiting events found dispatching network-vif-plugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:47 user nova-compute[74658]: WARNING nova.compute.manager [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Received unexpected event network-vif-plugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a for instance with vm_state building and task_state spawning.
Nov 16 15:33:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Received event network-vif-plugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:33:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] Acquiring lock "aa513122-cec4-4659-9827-6578827018aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:33:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] Lock "aa513122-cec4-4659-9827-6578827018aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:33:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] Lock "aa513122-cec4-4659-9827-6578827018aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] No waiting events found dispatching network-vif-plugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:33:47 user nova-compute[74658]: WARNING nova.compute.manager [req-24dd0d7a-8e73-47ec-a696-46d101e46ea8 req-066cecca-e9b0-4728-bf85-1c8ed27b8510 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Received unexpected event network-vif-plugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a for instance with vm_state building and task_state spawning.
Nov 16 15:33:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:33:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:33:48 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: aa513122-cec4-4659-9827-6578827018aa] Instance spawned successfully.
Nov 16 15:33:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:33:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:33:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:33:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:33:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:33:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:33:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:33:48 user nova-compute[74658]: INFO nova.compute.manager [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 16 15:33:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:33:48 user nova-compute[74658]: INFO nova.compute.manager [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Took 10.79 seconds to build instance.
Nov 16 15:33:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-02127002-1839-49f8-8210-75f9298c4fc6 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "aa513122-cec4-4659-9827-6578827018aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.874s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:33:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:33:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:33:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:33:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:33:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:33:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:02 user nova-compute[74658]: INFO nova.compute.manager [None req-856fe954-b0be-41da-b0c9-24c52a6f7e55 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Get console output
Nov 16 15:34:02 user nova-compute[74658]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 16 15:34:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:34:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:08 user nova-compute[74658]: INFO nova.compute.manager [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Terminating instance
Nov 16 15:34:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-4d98b9df-b8c3-4384-918e-61cd4f1d2fc8 req-bb2c7bc4-4499-4f9b-ab0b-196dfd1581a0 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Received event network-vif-unplugged-19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4d98b9df-b8c3-4384-918e-61cd4f1d2fc8 req-bb2c7bc4-4499-4f9b-ab0b-196dfd1581a0 service nova] Acquiring lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4d98b9df-b8c3-4384-918e-61cd4f1d2fc8 req-bb2c7bc4-4499-4f9b-ab0b-196dfd1581a0 service nova] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4d98b9df-b8c3-4384-918e-61cd4f1d2fc8 req-bb2c7bc4-4499-4f9b-ab0b-196dfd1581a0 service nova] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-4d98b9df-b8c3-4384-918e-61cd4f1d2fc8 req-bb2c7bc4-4499-4f9b-ab0b-196dfd1581a0 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] No waiting events found dispatching network-vif-unplugged-19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-4d98b9df-b8c3-4384-918e-61cd4f1d2fc8 req-bb2c7bc4-4499-4f9b-ab0b-196dfd1581a0 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Received event network-vif-unplugged-19d2fb15-214c-4db9-97c0-84013963d15a for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Instance destroyed successfully.
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.objects.instance [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lazy-loading 'resources' on Instance uuid 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:34:09 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:34:09 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=7876MB free_disk=25.16573715209961GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-636598775',display_name='tempest-VolumesActionsTest-instance-636598775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-636598775',id=33,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:32:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='315f2a06d6c0433a9846b31ff1c5ab34',ramdisk_id='',reservation_id='r-yqmc1ebb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-330921490',owner_user_name='tempest-VolumesActionsTest-330921490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:32:23Z,user_data=None,user_id='366e499875f84191b530cb66cc0ed9dd',uuid=60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19d2fb15-214c-4db9-97c0-84013963d15a", "address": "fa:16:3e:67:52:61", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d2fb15-21", "ovs_interfaceid": "19d2fb15-214c-4db9-97c0-84013963d15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converting VIF {"id": "19d2fb15-214c-4db9-97c0-84013963d15a", "address": "fa:16:3e:67:52:61", "network": {"id": "0f477b59-e600-4217-84f1-880770ec1db8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049772189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315f2a06d6c0433a9846b31ff1c5ab34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d2fb15-21", "ovs_interfaceid": "19d2fb15-214c-4db9-97c0-84013963d15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:61,bridge_name='br-int',has_traffic_filtering=True,id=19d2fb15-214c-4db9-97c0-84013963d15a,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d2fb15-21') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG os_vif [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:61,bridge_name='br-int',has_traffic_filtering=True,id=19d2fb15-214c-4db9-97c0-84013963d15a,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d2fb15-21') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19d2fb15-21, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47b63593-787a-4017-bfb2-281153c0c766) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: INFO os_vif [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:61,bridge_name='br-int',has_traffic_filtering=True,id=19d2fb15-214c-4db9-97c0-84013963d15a,network=Network(0f477b59-e600-4217-84f1-880770ec1db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d2fb15-21')
Nov 16 15:34:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Deleting instance files /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb_del
Nov 16 15:34:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Deletion of /opt/stack/data/nova/instances/60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb_del complete
Nov 16 15:34:09 user nova-compute[74658]: INFO nova.compute.manager [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 16 15:34:09 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 6c8dd806-c294-40dd-a13d-63659a1d5669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 97135af5-e020-482b-a54b-6cf30a5443d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 67d2aeee-7218-4e85-baa3-157643a4301e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ecc12081-92a2-47e0-a885-efd13f9b5965 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance aa513122-cec4-4659-9827-6578827018aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:09 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:34:09 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Took 0.50 seconds to deallocate network for instance.
Nov 16 15:34:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-3a775d9f-b2b0-405a-8af4-068e08f6e6a3 req-f6ebb270-3435-4e0d-9492-f4e7ac0aa51f service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Received event network-vif-deleted-19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:10 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Deleted allocations for instance 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb
Nov 16 15:34:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e2f58991-7e38-45e8-b8f9-474aa5e379d2 tempest-VolumesActionsTest-330921490 tempest-VolumesActionsTest-330921490-project-member] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.200s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-c5419cff-5d6b-4ffd-9c14-88ad843c6265 req-ff998227-7c9e-41b7-865c-af5ac98065f2 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Received event network-vif-plugged-19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c5419cff-5d6b-4ffd-9c14-88ad843c6265 req-ff998227-7c9e-41b7-865c-af5ac98065f2 service nova] Acquiring lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c5419cff-5d6b-4ffd-9c14-88ad843c6265 req-ff998227-7c9e-41b7-865c-af5ac98065f2 service nova] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c5419cff-5d6b-4ffd-9c14-88ad843c6265 req-ff998227-7c9e-41b7-865c-af5ac98065f2 service nova] Lock "60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-c5419cff-5d6b-4ffd-9c14-88ad843c6265 req-ff998227-7c9e-41b7-865c-af5ac98065f2 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] No waiting events found dispatching network-vif-plugged-19d2fb15-214c-4db9-97c0-84013963d15a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:34:10 user nova-compute[74658]: WARNING nova.compute.manager [req-c5419cff-5d6b-4ffd-9c14-88ad843c6265 req-ff998227-7c9e-41b7-865c-af5ac98065f2 service nova] [instance: 60ed0c5f-aa07-4de6-b8b0-998f3ff3fffb] Received unexpected event network-vif-plugged-19d2fb15-214c-4db9-97c0-84013963d15a for instance with vm_state deleted and task_state None.
Nov 16 15:34:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:34:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:34:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating instance_info_cache with network_info: [{"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:34:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-67d2aeee-7218-4e85-baa3-157643a4301e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:34:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:34:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:34:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:34:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:34:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:34:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:34:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:34:14 user nova-compute[74658]: INFO nova.compute.claims [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Claim successful on node user
Nov 16 15:34:14 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:34:14 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:34:14 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG nova.policy [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78e64660311e44e8aec0701ea52c2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e355315b27543ccacf00b9461cff1a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:34:14 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Creating image(s)
Nov 16 15:34:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "/opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "/opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "/opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk 1073741824" returned: 0 in 0.044s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Successfully created port: 5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.167s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Cannot resize image /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Ensure instance console log exists: /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Successfully updated port: 5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquired lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-dec7a8a6-6ebd-4585-9929-9a843b40aba4 req-03e4bb0b-ab41-4224-8582-c7e72638e203 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-changed-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-dec7a8a6-6ebd-4585-9929-9a843b40aba4 req-03e4bb0b-ab41-4224-8582-c7e72638e203 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Refreshing instance network info cache due to event network-changed-5c27e2c4-4109-4450-ab40-70fbd6056674. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dec7a8a6-6ebd-4585-9929-9a843b40aba4 req-03e4bb0b-ab41-4224-8582-c7e72638e203 service nova] Acquiring lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:34:15 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updating instance_info_cache with network_info: [{"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Releasing lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Instance network_info: |[{"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dec7a8a6-6ebd-4585-9929-9a843b40aba4 req-03e4bb0b-ab41-4224-8582-c7e72638e203 service nova] Acquired lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-dec7a8a6-6ebd-4585-9929-9a843b40aba4 req-03e4bb0b-ab41-4224-8582-c7e72638e203 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Refreshing network info cache for port 5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Start _get_guest_xml network_info=[{"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:34:16 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:34:16 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819937516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819937516',id=35,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfL30sylCzE4s7OaXUClxC/TLYSq+AkJw/cWYRvMCdN4KQS+9zm2S6f+A44zBkMEc4KoIAqpRUwHpjOnbCAuCPYrfLP0yUjLu5Mku/PeEcuRZ25l/ImXz70q859U/8ahQ==',key_name='tempest-keypair-1533894978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-vav0s65l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=396c5838-c4aa-4b02-9b9a-4f3296d85f2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.objects.instance [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'pci_devices' on Instance uuid 396c5838-c4aa-4b02-9b9a-4f3296d85f2f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:34:16 user nova-compute[74658]:   <uuid>396c5838-c4aa-4b02-9b9a-4f3296d85f2f</uuid>
Nov 16 15:34:16 user nova-compute[74658]:   <name>instance-00000023</name>
Nov 16 15:34:16 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:34:16 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:34:16 user nova-compute[74658]:   <metadata>
Nov 16 15:34:16 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:34:16 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:34:16 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1819937516</nova:name>
Nov 16 15:34:16 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:34:16</nova:creationTime>
Nov 16 15:34:16 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:34:16 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:34:16 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:34:16 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:34:16 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:34:16 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:34:16 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:34:16 user nova-compute[74658]:       <nova:owner>
Nov 16 15:34:16 user nova-compute[74658]:         <nova:user uuid="78e64660311e44e8aec0701ea52c2bb6">tempest-AttachVolumeShelveTestJSON-1521088540-project-member</nova:user>
Nov 16 15:34:16 user nova-compute[74658]:         <nova:project uuid="8e355315b27543ccacf00b9461cff1a0">tempest-AttachVolumeShelveTestJSON-1521088540</nova:project>
Nov 16 15:34:16 user nova-compute[74658]:       </nova:owner>
Nov 16 15:34:16 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:34:16 user nova-compute[74658]:       <nova:ports>
Nov 16 15:34:16 user nova-compute[74658]:         <nova:port uuid="5c27e2c4-4109-4450-ab40-70fbd6056674">
Nov 16 15:34:16 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 15:34:16 user nova-compute[74658]:         </nova:port>
Nov 16 15:34:16 user nova-compute[74658]:       </nova:ports>
Nov 16 15:34:16 user nova-compute[74658]:     </nova:instance>
Nov 16 15:34:16 user nova-compute[74658]:   </metadata>
Nov 16 15:34:16 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:34:16 user nova-compute[74658]:     <system>
Nov 16 15:34:16 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:34:16 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:34:16 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:34:16 user nova-compute[74658]:       <entry name="serial">396c5838-c4aa-4b02-9b9a-4f3296d85f2f</entry>
Nov 16 15:34:16 user nova-compute[74658]:       <entry name="uuid">396c5838-c4aa-4b02-9b9a-4f3296d85f2f</entry>
Nov 16 15:34:16 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:34:16 user nova-compute[74658]:     </system>
Nov 16 15:34:16 user nova-compute[74658]:   </sysinfo>
Nov 16 15:34:16 user nova-compute[74658]:   <os>
Nov 16 15:34:16 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:34:16 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:34:16 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:34:16 user nova-compute[74658]:   </os>
Nov 16 15:34:16 user nova-compute[74658]:   <features>
Nov 16 15:34:16 user nova-compute[74658]:     <acpi/>
Nov 16 15:34:16 user nova-compute[74658]:     <apic/>
Nov 16 15:34:16 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:34:16 user nova-compute[74658]:   </features>
Nov 16 15:34:16 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:34:16 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:34:16 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:34:16 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:34:16 user nova-compute[74658]:   </clock>
Nov 16 15:34:16 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:34:16 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:34:16 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:34:16 user nova-compute[74658]:   </cpu>
Nov 16 15:34:16 user nova-compute[74658]:   <devices>
Nov 16 15:34:16 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:34:16 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:34:16 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk"/>
Nov 16 15:34:16 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:34:16 user nova-compute[74658]:     </disk>
Nov 16 15:34:16 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:34:16 user nova-compute[74658]:       <mac address="fa:16:3e:29:5e:37"/>
Nov 16 15:34:16 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:34:16 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:34:16 user nova-compute[74658]:       <target dev="tap5c27e2c4-41"/>
Nov 16 15:34:16 user nova-compute[74658]:     </interface>
Nov 16 15:34:16 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:34:16 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/console.log" append="off"/>
Nov 16 15:34:16 user nova-compute[74658]:     </serial>
Nov 16 15:34:16 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:34:16 user nova-compute[74658]:     <video>
Nov 16 15:34:16 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:34:16 user nova-compute[74658]:     </video>
Nov 16 15:34:16 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:34:16 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:34:16 user nova-compute[74658]:     </rng>
Nov 16 15:34:16 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:34:16 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:34:16 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:34:16 user nova-compute[74658]:     </memballoon>
Nov 16 15:34:16 user nova-compute[74658]:   </devices>
Nov 16 15:34:16 user nova-compute[74658]: </domain>
Nov 16 15:34:16 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819937516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819937516',id=35,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfL30sylCzE4s7OaXUClxC/TLYSq+AkJw/cWYRvMCdN4KQS+9zm2S6f+A44zBkMEc4KoIAqpRUwHpjOnbCAuCPYrfLP0yUjLu5Mku/PeEcuRZ25l/ImXz70q859U/8ahQ==',key_name='tempest-keypair-1533894978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-vav0s65l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=396c5838-c4aa-4b02-9b9a-4f3296d85f2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG os_vif [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '660edf1a-3e6f-5875-b38d-8e3f8a024350', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c27e2c4-41, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c27e2c4-41, col_values=(('qos', UUID('c92001c4-bdd1-4583-b96c-d832c91e10a1')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c27e2c4-41, col_values=(('external_ids', {'iface-id': '5c27e2c4-4109-4450-ab40-70fbd6056674', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:5e:37', 'vm-uuid': '396c5838-c4aa-4b02-9b9a-4f3296d85f2f'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:16 user nova-compute[74658]: INFO os_vif [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41')
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] No VIF found with MAC fa:16:3e:29:5e:37, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-dec7a8a6-6ebd-4585-9929-9a843b40aba4 req-03e4bb0b-ab41-4224-8582-c7e72638e203 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updated VIF entry in instance network info cache for port 5c27e2c4-4109-4450-ab40-70fbd6056674. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-dec7a8a6-6ebd-4585-9929-9a843b40aba4 req-03e4bb0b-ab41-4224-8582-c7e72638e203 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updating instance_info_cache with network_info: [{"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:34:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-dec7a8a6-6ebd-4585-9929-9a843b40aba4 req-03e4bb0b-ab41-4224-8582-c7e72638e203 service nova] Releasing lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:34:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-521d49cb-7cd9-4f47-9b96-a8c17dbf31bb req-76798fce-8d04-4d28-b73a-7b2b3d38ac78 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-521d49cb-7cd9-4f47-9b96-a8c17dbf31bb req-76798fce-8d04-4d28-b73a-7b2b3d38ac78 service nova] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-521d49cb-7cd9-4f47-9b96-a8c17dbf31bb req-76798fce-8d04-4d28-b73a-7b2b3d38ac78 service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-521d49cb-7cd9-4f47-9b96-a8c17dbf31bb req-76798fce-8d04-4d28-b73a-7b2b3d38ac78 service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-521d49cb-7cd9-4f47-9b96-a8c17dbf31bb req-76798fce-8d04-4d28-b73a-7b2b3d38ac78 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] No waiting events found dispatching network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:34:17 user nova-compute[74658]: WARNING nova.compute.manager [req-521d49cb-7cd9-4f47-9b96-a8c17dbf31bb req-76798fce-8d04-4d28-b73a-7b2b3d38ac78 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received unexpected event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 for instance with vm_state building and task_state spawning.
Nov 16 15:34:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:34:19 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Instance spawned successfully.
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-cfb17cf8-76e5-4af2-820f-1e3b10f24f1d req-9a241857-60bb-44a9-9371-6d4e2b6443c4 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cfb17cf8-76e5-4af2-820f-1e3b10f24f1d req-9a241857-60bb-44a9-9371-6d4e2b6443c4 service nova] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cfb17cf8-76e5-4af2-820f-1e3b10f24f1d req-9a241857-60bb-44a9-9371-6d4e2b6443c4 service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-cfb17cf8-76e5-4af2-820f-1e3b10f24f1d req-9a241857-60bb-44a9-9371-6d4e2b6443c4 service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.compute.manager [req-cfb17cf8-76e5-4af2-820f-1e3b10f24f1d req-9a241857-60bb-44a9-9371-6d4e2b6443c4 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] No waiting events found dispatching network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:34:19 user nova-compute[74658]: WARNING nova.compute.manager [req-cfb17cf8-76e5-4af2-820f-1e3b10f24f1d req-9a241857-60bb-44a9-9371-6d4e2b6443c4 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received unexpected event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 for instance with vm_state building and task_state spawning.
Nov 16 15:34:19 user nova-compute[74658]: INFO nova.compute.manager [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 16 15:34:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:34:19 user nova-compute[74658]: INFO nova.compute.manager [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Took 5.82 seconds to build instance.
Nov 16 15:34:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01c9f084-ed3e-4ede-b6f6-da2d4a0c2f8f tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.916s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "97135af5-e020-482b-a54b-6cf30a5443d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "97135af5-e020-482b-a54b-6cf30a5443d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:33 user nova-compute[74658]: INFO nova.compute.manager [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Terminating instance
Nov 16 15:34:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-0aeee4a5-7382-4755-8e46-8837deeabe4b req-0a274cbc-359c-472e-a258-69b1d47e14de service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Received event network-vif-unplugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0aeee4a5-7382-4755-8e46-8837deeabe4b req-0a274cbc-359c-472e-a258-69b1d47e14de service nova] Acquiring lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0aeee4a5-7382-4755-8e46-8837deeabe4b req-0a274cbc-359c-472e-a258-69b1d47e14de service nova] Lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0aeee4a5-7382-4755-8e46-8837deeabe4b req-0a274cbc-359c-472e-a258-69b1d47e14de service nova] Lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-0aeee4a5-7382-4755-8e46-8837deeabe4b req-0a274cbc-359c-472e-a258-69b1d47e14de service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] No waiting events found dispatching network-vif-unplugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-0aeee4a5-7382-4755-8e46-8837deeabe4b req-0a274cbc-359c-472e-a258-69b1d47e14de service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Received event network-vif-unplugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:34:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:34 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Instance destroyed successfully.
Nov 16 15:34:34 user nova-compute[74658]: DEBUG nova.objects.instance [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'resources' on Instance uuid 97135af5-e020-482b-a54b-6cf30a5443d4 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1447727992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1447727992',id=24,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='621284eebf704320bacac96aedbc77a4',ramdisk_id='',reservation_id='r-dmw3a84j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:27:08Z,user_data=None,user_id='6ed5db501b2e4dcfb742e18dfdeae88b',uuid=97135af5-e020-482b-a54b-6cf30a5443d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "address": "fa:16:3e:dd:4c:bc", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ab6143-11", "ovs_interfaceid": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converting VIF {"id": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "address": "fa:16:3e:dd:4c:bc", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ab6143-11", "ovs_interfaceid": "f1ab6143-1173-4e25-8f85-0f6b4517b2f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1ab6143-1173-4e25-8f85-0f6b4517b2f0,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ab6143-11') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG os_vif [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1ab6143-1173-4e25-8f85-0f6b4517b2f0,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ab6143-11') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1ab6143-11, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7aad2cb5-3447-40d3-b788-984a09d526aa) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:34:34 user nova-compute[74658]: INFO os_vif [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1ab6143-1173-4e25-8f85-0f6b4517b2f0,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ab6143-11')
Nov 16 15:34:34 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Deleting instance files /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4_del
Nov 16 15:34:34 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Deletion of /opt/stack/data/nova/instances/97135af5-e020-482b-a54b-6cf30a5443d4_del complete
Nov 16 15:34:34 user nova-compute[74658]: INFO nova.compute.manager [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 16 15:34:34 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:34:34 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:34:34 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Took 0.45 seconds to deallocate network for instance.
Nov 16 15:34:34 user nova-compute[74658]: DEBUG nova.compute.manager [req-972639e7-7de5-484b-8716-fe42df0d18dc req-b2b5f262-6684-4ae6-b491-376a12cd11b0 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Received event network-vif-deleted-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:34 user nova-compute[74658]: INFO nova.compute.manager [req-972639e7-7de5-484b-8716-fe42df0d18dc req-b2b5f262-6684-4ae6-b491-376a12cd11b0 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Neutron deleted interface f1ab6143-1173-4e25-8f85-0f6b4517b2f0; detaching it from the instance and deleting it from the info cache
Nov 16 15:34:34 user nova-compute[74658]: DEBUG nova.network.neutron [req-972639e7-7de5-484b-8716-fe42df0d18dc req-b2b5f262-6684-4ae6-b491-376a12cd11b0 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-972639e7-7de5-484b-8716-fe42df0d18dc req-b2b5f262-6684-4ae6-b491-376a12cd11b0 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Detach interface failed, port_id=f1ab6143-1173-4e25-8f85-0f6b4517b2f0, reason: Instance 97135af5-e020-482b-a54b-6cf30a5443d4 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:35 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Deleted allocations for instance 97135af5-e020-482b-a54b-6cf30a5443d4
Nov 16 15:34:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-aeb5eb50-d3a1-428f-98cd-84dc48ff280e tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "97135af5-e020-482b-a54b-6cf30a5443d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.915s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-8dda79e2-ab83-4c30-9f6c-673dd2602a71 req-39f78c18-f323-4965-81a8-3ba0ed6b4974 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Received event network-vif-plugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8dda79e2-ab83-4c30-9f6c-673dd2602a71 req-39f78c18-f323-4965-81a8-3ba0ed6b4974 service nova] Acquiring lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8dda79e2-ab83-4c30-9f6c-673dd2602a71 req-39f78c18-f323-4965-81a8-3ba0ed6b4974 service nova] Lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8dda79e2-ab83-4c30-9f6c-673dd2602a71 req-39f78c18-f323-4965-81a8-3ba0ed6b4974 service nova] Lock "97135af5-e020-482b-a54b-6cf30a5443d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-8dda79e2-ab83-4c30-9f6c-673dd2602a71 req-39f78c18-f323-4965-81a8-3ba0ed6b4974 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] No waiting events found dispatching network-vif-plugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:34:35 user nova-compute[74658]: WARNING nova.compute.manager [req-8dda79e2-ab83-4c30-9f6c-673dd2602a71 req-39f78c18-f323-4965-81a8-3ba0ed6b4974 service nova] [instance: 97135af5-e020-482b-a54b-6cf30a5443d4] Received unexpected event network-vif-plugged-f1ab6143-1173-4e25-8f85-0f6b4517b2f0 for instance with vm_state deleted and task_state None.
Nov 16 15:34:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:53 user nova-compute[74658]: INFO nova.compute.manager [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Terminating instance
Nov 16 15:34:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-c8611b65-a022-4c40-ba77-cdb6f9afad5a req-4b64b975-98c6-4bb7-a071-9e854d717fa1 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-unplugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c8611b65-a022-4c40-ba77-cdb6f9afad5a req-4b64b975-98c6-4bb7-a071-9e854d717fa1 service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c8611b65-a022-4c40-ba77-cdb6f9afad5a req-4b64b975-98c6-4bb7-a071-9e854d717fa1 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c8611b65-a022-4c40-ba77-cdb6f9afad5a req-4b64b975-98c6-4bb7-a071-9e854d717fa1 service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-c8611b65-a022-4c40-ba77-cdb6f9afad5a req-4b64b975-98c6-4bb7-a071-9e854d717fa1 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-unplugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-c8611b65-a022-4c40-ba77-cdb6f9afad5a req-4b64b975-98c6-4bb7-a071-9e854d717fa1 service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-unplugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:34:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Instance destroyed successfully.
Nov 16 15:34:53 user nova-compute[74658]: DEBUG nova.objects.instance [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'resources' on Instance uuid 6c8dd806-c294-40dd-a13d-63659a1d5669 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-855420044',display_name='tempest-AttachVolumeTestJSON-server-855420044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-855420044',id=21,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0aQzQPL9O0sCZYH1ntlAkbDeS1BfXalYyPNg5mzbOT3rQ3DQzwLD0COpv3rF6yI3D5ElP0hp1r6opeP6BA0IQrQD2St0Ieh9euvcCJptTl1EjscoAuo3T+KfsTBHg0uQ==',key_name='tempest-keypair-2113042845',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-rfy50ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:33:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=6c8dd806-c294-40dd-a13d-63659a1d5669,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "address": "fa:16:3e:f1:80:2c", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd946f4-de", "ovs_interfaceid": "add946f4-de44-48b9-9de4-3c76c1d1c8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG os_vif [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadd946f4-de, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b655bad-c9e8-44cc-8960-2e02947e9675) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:53 user nova-compute[74658]: INFO os_vif [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:80:2c,bridge_name='br-int',has_traffic_filtering=True,id=add946f4-de44-48b9-9de4-3c76c1d1c8ae,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd946f4-de')
Nov 16 15:34:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Deleting instance files /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669_del
Nov 16 15:34:53 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Deletion of /opt/stack/data/nova/instances/6c8dd806-c294-40dd-a13d-63659a1d5669_del complete
Nov 16 15:34:53 user nova-compute[74658]: INFO nova.compute.manager [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 16 15:34:53 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:34:53 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:34:54 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:34:54 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Took 0.62 seconds to deallocate network for instance.
Nov 16 15:34:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-137c70eb-95a9-4aad-9d3b-36cfc2e1486d req-af49f57e-e601-4c28-8919-763e5762955b service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-deleted-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:54 user nova-compute[74658]: INFO nova.compute.manager [req-137c70eb-95a9-4aad-9d3b-36cfc2e1486d req-af49f57e-e601-4c28-8919-763e5762955b service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Neutron deleted interface add946f4-de44-48b9-9de4-3c76c1d1c8ae; detaching it from the instance and deleting it from the info cache
Nov 16 15:34:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-137c70eb-95a9-4aad-9d3b-36cfc2e1486d req-af49f57e-e601-4c28-8919-763e5762955b service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:34:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-137c70eb-95a9-4aad-9d3b-36cfc2e1486d req-af49f57e-e601-4c28-8919-763e5762955b service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Detach interface failed, port_id=add946f4-de44-48b9-9de4-3c76c1d1c8ae, reason: Instance 6c8dd806-c294-40dd-a13d-63659a1d5669 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:34:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:54 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:34:54 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:34:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:54 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Deleted allocations for instance 6c8dd806-c294-40dd-a13d-63659a1d5669
Nov 16 15:34:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7c076015-dbad-42f2-bc12-d7281552c91d tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.843s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-4b233e75-7cc8-48ea-b87d-21319fd6c583 req-5bfec69b-ddc8-44f4-9d1b-c1c10a81712c service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4b233e75-7cc8-48ea-b87d-21319fd6c583 req-5bfec69b-ddc8-44f4-9d1b-c1c10a81712c service nova] Acquiring lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:34:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4b233e75-7cc8-48ea-b87d-21319fd6c583 req-5bfec69b-ddc8-44f4-9d1b-c1c10a81712c service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:34:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4b233e75-7cc8-48ea-b87d-21319fd6c583 req-5bfec69b-ddc8-44f4-9d1b-c1c10a81712c service nova] Lock "6c8dd806-c294-40dd-a13d-63659a1d5669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:34:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-4b233e75-7cc8-48ea-b87d-21319fd6c583 req-5bfec69b-ddc8-44f4-9d1b-c1c10a81712c service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] No waiting events found dispatching network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:34:55 user nova-compute[74658]: WARNING nova.compute.manager [req-4b233e75-7cc8-48ea-b87d-21319fd6c583 req-5bfec69b-ddc8-44f4-9d1b-c1c10a81712c service nova] [instance: 6c8dd806-c294-40dd-a13d-63659a1d5669] Received unexpected event network-vif-plugged-add946f4-de44-48b9-9de4-3c76c1d1c8ae for instance with vm_state deleted and task_state None.
Nov 16 15:34:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:34:59 user nova-compute[74658]: DEBUG nova.compute.manager [req-4a722fc8-4d85-4a51-8e63-a90f04fbfa34 req-47275448-1f6c-490f-b612-b8d2a28a42b9 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-changed-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:34:59 user nova-compute[74658]: DEBUG nova.compute.manager [req-4a722fc8-4d85-4a51-8e63-a90f04fbfa34 req-47275448-1f6c-490f-b612-b8d2a28a42b9 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Refreshing instance network info cache due to event network-changed-8845dcec-73a4-4fbc-a835-88ced3593d56. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:34:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4a722fc8-4d85-4a51-8e63-a90f04fbfa34 req-47275448-1f6c-490f-b612-b8d2a28a42b9 service nova] Acquiring lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:34:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4a722fc8-4d85-4a51-8e63-a90f04fbfa34 req-47275448-1f6c-490f-b612-b8d2a28a42b9 service nova] Acquired lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:34:59 user nova-compute[74658]: DEBUG nova.network.neutron [req-4a722fc8-4d85-4a51-8e63-a90f04fbfa34 req-47275448-1f6c-490f-b612-b8d2a28a42b9 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Refreshing network info cache for port 8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG nova.network.neutron [req-4a722fc8-4d85-4a51-8e63-a90f04fbfa34 req-47275448-1f6c-490f-b612-b8d2a28a42b9 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updated VIF entry in instance network info cache for port 8845dcec-73a4-4fbc-a835-88ced3593d56. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG nova.network.neutron [req-4a722fc8-4d85-4a51-8e63-a90f04fbfa34 req-47275448-1f6c-490f-b612-b8d2a28a42b9 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updating instance_info_cache with network_info: [{"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4a722fc8-4d85-4a51-8e63-a90f04fbfa34 req-47275448-1f6c-490f-b612-b8d2a28a42b9 service nova] Releasing lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-5eb15c39-19c5-4ad6-aab0-72ab8ddc5c24 req-0c2dd6f9-3e61-46f8-8511-ed4a70130570 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-changed-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-5eb15c39-19c5-4ad6-aab0-72ab8ddc5c24 req-0c2dd6f9-3e61-46f8-8511-ed4a70130570 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Refreshing instance network info cache due to event network-changed-8845dcec-73a4-4fbc-a835-88ced3593d56. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5eb15c39-19c5-4ad6-aab0-72ab8ddc5c24 req-0c2dd6f9-3e61-46f8-8511-ed4a70130570 service nova] Acquiring lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5eb15c39-19c5-4ad6-aab0-72ab8ddc5c24 req-0c2dd6f9-3e61-46f8-8511-ed4a70130570 service nova] Acquired lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG nova.network.neutron [req-5eb15c39-19c5-4ad6-aab0-72ab8ddc5c24 req-0c2dd6f9-3e61-46f8-8511-ed4a70130570 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Refreshing network info cache for port 8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:00 user nova-compute[74658]: INFO nova.compute.manager [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Detaching volume b81a9893-9337-4047-a903-9bde5b2afab7
Nov 16 15:35:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:00 user nova-compute[74658]: INFO nova.virt.block_device [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Attempting to driver detach volume b81a9893-9337-4047-a903-9bde5b2afab7 from mountpoint /dev/vdb
Nov 16 15:35:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Attempting to detach device vdb from instance ecc12081-92a2-47e0-a885-efd13f9b5965 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:35:00 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:35:00 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:35:00 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:35:00 user nova-compute[74658]:   <serial>b81a9893-9337-4047-a903-9bde5b2afab7</serial>
Nov 16 15:35:00 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:35:00 user nova-compute[74658]: </disk>
Nov 16 15:35:00 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:35:00 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Successfully detached device vdb from instance ecc12081-92a2-47e0-a885-efd13f9b5965 from the persistent domain config.
Nov 16 15:35:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ecc12081-92a2-47e0-a885-efd13f9b5965 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:35:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:35:00 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:35:00 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:35:00 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:35:00 user nova-compute[74658]:   <serial>b81a9893-9337-4047-a903-9bde5b2afab7</serial>
Nov 16 15:35:00 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:35:00 user nova-compute[74658]: </disk>
Nov 16 15:35:00 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:35:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ecc12081-92a2-47e0-a885-efd13f9b5965 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:35:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-5eb15c39-19c5-4ad6-aab0-72ab8ddc5c24 req-0c2dd6f9-3e61-46f8-8511-ed4a70130570 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updated VIF entry in instance network info cache for port 8845dcec-73a4-4fbc-a835-88ced3593d56. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:35:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-5eb15c39-19c5-4ad6-aab0-72ab8ddc5c24 req-0c2dd6f9-3e61-46f8-8511-ed4a70130570 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updating instance_info_cache with network_info: [{"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5eb15c39-19c5-4ad6-aab0-72ab8ddc5c24 req-0c2dd6f9-3e61-46f8-8511-ed4a70130570 service nova] Releasing lock "refresh_cache-ecc12081-92a2-47e0-a885-efd13f9b5965" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "67d2aeee-7218-4e85-baa3-157643a4301e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:03 user nova-compute[74658]: INFO nova.compute.manager [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Terminating instance
Nov 16 15:35:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-ae0a712a-ce8e-4d37-a8cd-f595d9d99572 req-84dd0a33-0648-4c3a-b3f2-eff089c7c160 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-vif-unplugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ae0a712a-ce8e-4d37-a8cd-f595d9d99572 req-84dd0a33-0648-4c3a-b3f2-eff089c7c160 service nova] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ae0a712a-ce8e-4d37-a8cd-f595d9d99572 req-84dd0a33-0648-4c3a-b3f2-eff089c7c160 service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ae0a712a-ce8e-4d37-a8cd-f595d9d99572 req-84dd0a33-0648-4c3a-b3f2-eff089c7c160 service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-ae0a712a-ce8e-4d37-a8cd-f595d9d99572 req-84dd0a33-0648-4c3a-b3f2-eff089c7c160 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] No waiting events found dispatching network-vif-unplugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-ae0a712a-ce8e-4d37-a8cd-f595d9d99572 req-84dd0a33-0648-4c3a-b3f2-eff089c7c160 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-vif-unplugged-d530bb58-eab8-4783-b16b-b1ec126da39f for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Instance destroyed successfully.
Nov 16 15:35:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'resources' on Instance uuid 67d2aeee-7218-4e85-baa3-157643a4301e {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-966150362',display_name='tempest-ServerActionsTestOtherA-server-966150362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-966150362',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfs3x9tKyy9KHJUedCxh49P9LH14YRsacTcDaxEVd8YqO4Cuyb8pJja3XT1OhFAuM946OKuatB2JwDtDIzcfi6ebK97F+SRlzAxuSg9qPWnSDGTyfFCtkcgNG6s/nMQMw==',key_name='tempest-keypair-1686675082',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:30:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-bmp0xx53',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=67d2aeee-7218-4e85-baa3-157643a4301e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "d530bb58-eab8-4783-b16b-b1ec126da39f", "address": "fa:16:3e:26:89:6f", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd530bb58-ea", "ovs_interfaceid": "d530bb58-eab8-4783-b16b-b1ec126da39f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_vif [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd530bb58-ea, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=207b0b71-beba-4fc8-8e5a-9490e8956298) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:04 user nova-compute[74658]: INFO os_vif [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=d530bb58-eab8-4783-b16b-b1ec126da39f,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd530bb58-ea')
Nov 16 15:35:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucsVCmpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:35:04 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccbe6cb-bc72-4334-afe4-456e04b1b904]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:35:04 user nova-compute[74658]: No targets found.
Nov 16 15:35:04 user nova-compute[74658]: iSNS:
Nov 16 15:35:04 user nova-compute[74658]: No targets found.
Nov 16 15:35:04 user nova-compute[74658]: STATIC:
Nov 16 15:35:04 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7
Nov 16 15:35:04 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:35:04 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:35:04 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a
Nov 16 15:35:04 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:35:04 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:35:04 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014
Nov 16 15:35:04 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:35:04 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:35:04 user nova-compute[74658]: FIRMWARE:
Nov 16 15:35:04 user nova-compute[74658]: No targets found.
Nov 16 15:35:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:35:04 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:35:04 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d304041c-4eb3-4ab7-a5f1-db4699d3dde1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[099d1036-c85f-484a-93a3-987462d63819]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:35:04 user nova-compute[74658]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:35:04 user nova-compute[74658]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:35:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a (non-flash)
Nov 16 15:35:04 user nova-compute[74658]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:35:04 user nova-compute[74658]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:35:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f073c98bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a'): ({'sdf'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Removing single pathed devices sdf {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b789fa-0d23-4479-b63b-9b6693e5b86a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[214405a4-2ef1-473d-be92-c370ce5b5d27]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Flushing IO for device /dev/sdf {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[780c74d1-7550-47d8-a06a-39aae45d8a0d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cfe19e-ff58-4b8e-9a11-b9985f39d592]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] SCSI volumes sdf have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOec91cc34-9e73f273ce49e43e', '/dev/disk/by-id/scsi-23965373366323733', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ec91cc34') {{(pid=84815) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 15:35:04 user nova-compute[74658]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOec91cc34-9e73f273ce49e43e
Nov 16 15:35:04 user nova-compute[74658]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23965373366323733
Nov 16 15:35:04 user nova-compute[74658]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ec91cc34
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[968694bd-65bc-440b-8005-cb269b59c6a8]: (4, None) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5634fb19-677b-437e-9b9c-b8c15418e424]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d801a33-a339-4b4d-a8f3-c3041068b1c6]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260]
Nov 16 15:35:04 user nova-compute[74658]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a, portal: 172.16.0.220,3260] successful.
Nov 16 15:35:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1d3c13-65f3-4338-91c5-5ee6dbc0392a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[463d272d-61fd-43f8-be27-127055942484]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] <== disconnect_volume: return (333ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:35:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Deleting instance files /opt/stack/data/nova/instances/67d2aeee-7218-4e85-baa3-157643a4301e_del
Nov 16 15:35:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Deletion of /opt/stack/data/nova/instances/67d2aeee-7218-4e85-baa3-157643a4301e_del complete
Nov 16 15:35:04 user nova-compute[74658]: INFO nova.compute.manager [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 16 15:35:04 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:35:04 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:35:05 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:05 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Took 0.89 seconds to deallocate network for instance.
Nov 16 15:35:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-c2680115-05dc-4f86-9a22-b2e7918f7796 req-1ae0fa6c-ba1d-44b0-a77b-ab210e84d1d3 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c2680115-05dc-4f86-9a22-b2e7918f7796 req-1ae0fa6c-ba1d-44b0-a77b-ab210e84d1d3 service nova] Acquiring lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c2680115-05dc-4f86-9a22-b2e7918f7796 req-1ae0fa6c-ba1d-44b0-a77b-ab210e84d1d3 service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c2680115-05dc-4f86-9a22-b2e7918f7796 req-1ae0fa6c-ba1d-44b0-a77b-ab210e84d1d3 service nova] Lock "67d2aeee-7218-4e85-baa3-157643a4301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-c2680115-05dc-4f86-9a22-b2e7918f7796 req-1ae0fa6c-ba1d-44b0-a77b-ab210e84d1d3 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] No waiting events found dispatching network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:05 user nova-compute[74658]: WARNING nova.compute.manager [req-c2680115-05dc-4f86-9a22-b2e7918f7796 req-1ae0fa6c-ba1d-44b0-a77b-ab210e84d1d3 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received unexpected event network-vif-plugged-d530bb58-eab8-4783-b16b-b1ec126da39f for instance with vm_state active and task_state deleting.
Nov 16 15:35:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-c2680115-05dc-4f86-9a22-b2e7918f7796 req-1ae0fa6c-ba1d-44b0-a77b-ab210e84d1d3 service nova] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Received event network-vif-deleted-d530bb58-eab8-4783-b16b-b1ec126da39f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:06 user nova-compute[74658]: INFO nova.compute.manager [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Took 0.70 seconds to detach 1 volumes for instance.
Nov 16 15:35:06 user nova-compute[74658]: DEBUG nova.compute.manager [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 67d2aeee-7218-4e85-baa3-157643a4301e] Deleting volume: ce1d3c13-65f3-4338-91c5-5ee6dbc0392a {{(pid=74658) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 15:35:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:06 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:35:06 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:35:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:06 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Deleted allocations for instance 67d2aeee-7218-4e85-baa3-157643a4301e
Nov 16 15:35:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8b5b1206-bc54-4880-a781-f01e539fe3b0 tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "67d2aeee-7218-4e85-baa3-157643a4301e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.265s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:07 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:35:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:35:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:35:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:35:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:35:07 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:35:07 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 7ef751d1-099a-4b46-b08d-99929d449ef9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:35:07 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updating instance_info_cache with network_info: [{"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-7ef751d1-099a-4b46-b08d-99929d449ef9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:35:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:35:07 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:10 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:35:10 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:35:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8218MB free_disk=25.309505462646484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ef751d1-099a-4b46-b08d-99929d449ef9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 766f2096-3fe3-4d6f-93cd-2a07c8967197 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ecc12081-92a2-47e0-a885-efd13f9b5965 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance aa513122-cec4-4659-9827-6578827018aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 396c5838-c4aa-4b02-9b9a-4f3296d85f2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:35:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:35:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:35:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:35:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:35:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:35:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:35:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:35:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:35:17 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:35:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:21 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ecc12081-92a2-47e0-a885-efd13f9b5965 is timed out.
Nov 16 15:35:21 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Successfully detached device vdb from instance ecc12081-92a2-47e0-a885-efd13f9b5965 from the live domain config.
Nov 16 15:35:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLblfzpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:35:21 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedb6431-1f21-440b-bc16-77e418b4f0df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f01970-b765-493f-86b2-b6c3a2e49688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:35:21 user nova-compute[74658]: No targets found.
Nov 16 15:35:21 user nova-compute[74658]: iSNS:
Nov 16 15:35:21 user nova-compute[74658]: No targets found.
Nov 16 15:35:21 user nova-compute[74658]: STATIC:
Nov 16 15:35:21 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7
Nov 16 15:35:21 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:35:21 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:35:21 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014
Nov 16 15:35:21 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:35:21 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:35:21 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:a0f01970-b765-493f-86b2-b6c3a2e49688
Nov 16 15:35:21 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:35:21 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:35:21 user nova-compute[74658]: FIRMWARE:
Nov 16 15:35:21 user nova-compute[74658]: No targets found.
Nov 16 15:35:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:35:21 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:35:21 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7626b23d-c9df-445c-92dc-876ac18a3dcd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f01970-b765-493f-86b2-b6c3a2e49688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b145a4-4375-4f87-8dd9-f9fd26cc6a5f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f01970-b765-493f-86b2-b6c3a2e49688 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:35:21 user nova-compute[74658]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:35:21 user nova-compute[74658]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f01970-b765-493f-86b2-b6c3a2e49688 (non-flash)
Nov 16 15:35:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 (non-flash)
Nov 16 15:35:21 user nova-compute[74658]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:35:21 user nova-compute[74658]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f01970-b765-493f-86b2-b6c3a2e49688 (non-flash)
Nov 16 15:35:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07304f11b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[420c131a-ad63-4599-ab27-a1dce7b8b4a6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e54833-4985-4231-bcb8-8df2669d3d58]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[586f294d-470c-47e1-82b3-6671b7fed080]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.201s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a279b7-2fff-48be-be4d-4bfe0d46f73f]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.067s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eac34e-ebed-46d6-bd14-0532d60ba9bd]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.310s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab8bb20-6eb3-4477-a724-f5fdb39f1bb7]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7, portal: 172.16.0.220,3260]
Nov 16 15:35:21 user nova-compute[74658]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7, portal: 172.16.0.220,3260] successful.
Nov 16 15:35:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a9893-9337-4047-a903-9bde5b2afab7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7789a15d-cb24-462e-9955-29017881521b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.855s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] <== disconnect_volume: return (856ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:35:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:35:22 user nova-compute[74658]: DEBUG nova.objects.instance [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'flavor' on Instance uuid ecc12081-92a2-47e0-a885-efd13f9b5965 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:35:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdf68519-04d3-45ad-b076-2f63c5478dea tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.712s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:24 user nova-compute[74658]: INFO nova.compute.manager [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Terminating instance
Nov 16 15:35:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG nova.compute.manager [req-aa1a9f1a-ccf8-4eaf-8e87-b3b412f86db9 req-bac58483-5f3c-49f3-9a22-524265a7284a service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Received event network-vif-unplugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-aa1a9f1a-ccf8-4eaf-8e87-b3b412f86db9 req-bac58483-5f3c-49f3-9a22-524265a7284a service nova] Acquiring lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-aa1a9f1a-ccf8-4eaf-8e87-b3b412f86db9 req-bac58483-5f3c-49f3-9a22-524265a7284a service nova] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-aa1a9f1a-ccf8-4eaf-8e87-b3b412f86db9 req-bac58483-5f3c-49f3-9a22-524265a7284a service nova] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG nova.compute.manager [req-aa1a9f1a-ccf8-4eaf-8e87-b3b412f86db9 req-bac58483-5f3c-49f3-9a22-524265a7284a service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] No waiting events found dispatching network-vif-unplugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:24 user nova-compute[74658]: DEBUG nova.compute.manager [req-aa1a9f1a-ccf8-4eaf-8e87-b3b412f86db9 req-bac58483-5f3c-49f3-9a22-524265a7284a service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Received event network-vif-unplugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:35:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Instance destroyed successfully.
Nov 16 15:35:25 user nova-compute[74658]: DEBUG nova.objects.instance [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lazy-loading 'resources' on Instance uuid 766f2096-3fe3-4d6f-93cd-2a07c8967197 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2022950601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2022950601',id=16,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='621284eebf704320bacac96aedbc77a4',ramdisk_id='',reservation_id='r-vutb0h15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:23:14Z,user_data=None,user_id='6ed5db501b2e4dcfb742e18dfdeae88b',uuid=766f2096-3fe3-4d6f-93cd-2a07c8967197,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converting VIF {"id": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "address": "fa:16:3e:2e:f6:1c", "network": {"id": "2f540237-0d27-432a-a4e2-a149210adb2e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-633305914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621284eebf704320bacac96aedbc77a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1d2da0-50", "ovs_interfaceid": "3c1d2da0-50ce-4a45-b959-9d864ca98a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f6:1c,bridge_name='br-int',has_traffic_filtering=True,id=3c1d2da0-50ce-4a45-b959-9d864ca98a79,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1d2da0-50') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG os_vif [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f6:1c,bridge_name='br-int',has_traffic_filtering=True,id=3c1d2da0-50ce-4a45-b959-9d864ca98a79,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1d2da0-50') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c1d2da0-50, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d605af99-b27f-4dc0-809f-ca6cea6f456f) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:25 user nova-compute[74658]: INFO os_vif [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f6:1c,bridge_name='br-int',has_traffic_filtering=True,id=3c1d2da0-50ce-4a45-b959-9d864ca98a79,network=Network(2f540237-0d27-432a-a4e2-a149210adb2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1d2da0-50')
Nov 16 15:35:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Deleting instance files /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197_del
Nov 16 15:35:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Deletion of /opt/stack/data/nova/instances/766f2096-3fe3-4d6f-93cd-2a07c8967197_del complete
Nov 16 15:35:25 user nova-compute[74658]: INFO nova.compute.manager [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 15:35:25 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:25 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Took 0.53 seconds to deallocate network for instance.
Nov 16 15:35:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:26 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:35:26 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:35:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:26 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Deleted allocations for instance 766f2096-3fe3-4d6f-93cd-2a07c8967197
Nov 16 15:35:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d53d0b0b-d2a7-42d9-87b2-61789e14ca35 tempest-ServerBootFromVolumeStableRescueTest-1170309652 tempest-ServerBootFromVolumeStableRescueTest-1170309652-project-member] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.835s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-b128e55b-4a40-4a7c-abcb-43f06d81f860 req-fd2988f5-89fe-4761-ab3b-fcc1178cb3ef service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Received event network-vif-plugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b128e55b-4a40-4a7c-abcb-43f06d81f860 req-fd2988f5-89fe-4761-ab3b-fcc1178cb3ef service nova] Acquiring lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b128e55b-4a40-4a7c-abcb-43f06d81f860 req-fd2988f5-89fe-4761-ab3b-fcc1178cb3ef service nova] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b128e55b-4a40-4a7c-abcb-43f06d81f860 req-fd2988f5-89fe-4761-ab3b-fcc1178cb3ef service nova] Lock "766f2096-3fe3-4d6f-93cd-2a07c8967197-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-b128e55b-4a40-4a7c-abcb-43f06d81f860 req-fd2988f5-89fe-4761-ab3b-fcc1178cb3ef service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] No waiting events found dispatching network-vif-plugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:26 user nova-compute[74658]: WARNING nova.compute.manager [req-b128e55b-4a40-4a7c-abcb-43f06d81f860 req-fd2988f5-89fe-4761-ab3b-fcc1178cb3ef service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Received unexpected event network-vif-plugged-3c1d2da0-50ce-4a45-b959-9d864ca98a79 for instance with vm_state deleted and task_state None.
Nov 16 15:35:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-b128e55b-4a40-4a7c-abcb-43f06d81f860 req-fd2988f5-89fe-4761-ab3b-fcc1178cb3ef service nova] [instance: 766f2096-3fe3-4d6f-93cd-2a07c8967197] Received event network-vif-deleted-3c1d2da0-50ce-4a45-b959-9d864ca98a79 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-ad3e285a-c549-451c-a95f-ca999b961b5c req-b9908678-9956-466b-87ed-7b3d649f4a3e service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Received event network-changed-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-ad3e285a-c549-451c-a95f-ca999b961b5c req-b9908678-9956-466b-87ed-7b3d649f4a3e service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Refreshing instance network info cache due to event network-changed-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:35:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ad3e285a-c549-451c-a95f-ca999b961b5c req-b9908678-9956-466b-87ed-7b3d649f4a3e service nova] Acquiring lock "refresh_cache-aa513122-cec4-4659-9827-6578827018aa" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:35:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ad3e285a-c549-451c-a95f-ca999b961b5c req-b9908678-9956-466b-87ed-7b3d649f4a3e service nova] Acquired lock "refresh_cache-aa513122-cec4-4659-9827-6578827018aa" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:35:29 user nova-compute[74658]: DEBUG nova.network.neutron [req-ad3e285a-c549-451c-a95f-ca999b961b5c req-b9908678-9956-466b-87ed-7b3d649f4a3e service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Refreshing network info cache for port c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG nova.network.neutron [req-ad3e285a-c549-451c-a95f-ca999b961b5c req-b9908678-9956-466b-87ed-7b3d649f4a3e service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Updated VIF entry in instance network info cache for port c1acc58b-3c96-4d93-bb7c-0d6c55115b1a. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG nova.network.neutron [req-ad3e285a-c549-451c-a95f-ca999b961b5c req-b9908678-9956-466b-87ed-7b3d649f4a3e service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Updating instance_info_cache with network_info: [{"id": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "address": "fa:16:3e:39:bc:a2", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1acc58b-3c", "ovs_interfaceid": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ad3e285a-c549-451c-a95f-ca999b961b5c req-b9908678-9956-466b-87ed-7b3d649f4a3e service nova] Releasing lock "refresh_cache-aa513122-cec4-4659-9827-6578827018aa" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "aa513122-cec4-4659-9827-6578827018aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "aa513122-cec4-4659-9827-6578827018aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "aa513122-cec4-4659-9827-6578827018aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "aa513122-cec4-4659-9827-6578827018aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "aa513122-cec4-4659-9827-6578827018aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:30 user nova-compute[74658]: INFO nova.compute.manager [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Terminating instance
Nov 16 15:35:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:31 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: aa513122-cec4-4659-9827-6578827018aa] Instance destroyed successfully.
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.objects.instance [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'resources' on Instance uuid aa513122-cec4-4659-9827-6578827018aa {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-471800252',display_name='tempest-TestVolumeBootPattern-server-471800252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-471800252',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa3gqCorV1WbIg5i//0wnlopR+3KlyeNwvcR7SHxTAoz1md6ZPUq6Nr5c+6nYZB4Ns6g0kjBKvILHRe+adcrSzLJ8v98clK+l5Pw4QpWw7oSlS+Kt7nCSty+cuvnOaubg==',key_name='tempest-TestVolumeBootPattern-1945158636',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-rcvuz3c4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:33:48Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=aa513122-cec4-4659-9827-6578827018aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "address": "fa:16:3e:39:bc:a2", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1acc58b-3c", "ovs_interfaceid": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "address": "fa:16:3e:39:bc:a2", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1acc58b-3c", "ovs_interfaceid": "c1acc58b-3c96-4d93-bb7c-0d6c55115b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:bc:a2,bridge_name='br-int',has_traffic_filtering=True,id=c1acc58b-3c96-4d93-bb7c-0d6c55115b1a,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1acc58b-3c') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_vif [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:bc:a2,bridge_name='br-int',has_traffic_filtering=True,id=c1acc58b-3c96-4d93-bb7c-0d6c55115b1a,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1acc58b-3c') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1acc58b-3c, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4875d5d2-2fe8-41eb-b317-85108c758ce4) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:31 user nova-compute[74658]: INFO os_vif [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:bc:a2,bridge_name='br-int',has_traffic_filtering=True,id=c1acc58b-3c96-4d93-bb7c-0d6c55115b1a,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1acc58b-3c')
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJDPvkmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:35:31 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b754bd7-ca8a-4436-921f-a9bdd7cf2aee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:35:31 user nova-compute[74658]: No targets found.
Nov 16 15:35:31 user nova-compute[74658]: iSNS:
Nov 16 15:35:31 user nova-compute[74658]: No targets found.
Nov 16 15:35:31 user nova-compute[74658]: STATIC:
Nov 16 15:35:31 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014
Nov 16 15:35:31 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:35:31 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:35:31 user nova-compute[74658]: FIRMWARE:
Nov 16 15:35:31 user nova-compute[74658]: No targets found.
Nov 16 15:35:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:35:31 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:35:31 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cc9a32-d472-497b-a68e-3f1a30127959]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c891be3-7804-400f-be71-d43505a0d496]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:35:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:35:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06f07a9b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[036ce435-a1e9-4fa5-8366-cfa9f036a38f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e84b3c-9d6e-4a5d-924b-36d17bf8e3df]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb976844-d132-4839-b87d-02c2d5261271]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[00107c3e-071e-4737-ab41-71d0f51a6e03]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e9a81eac', '/dev/disk/by-id/scsi-23238616332383661', '/dev/disk/by-id/scsi-1SCST_BIOe9a81eac-28ac286a2b3b3c0b') {{(pid=84815) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5359a1-f277-4d56-9d57-538c8ab052b3]: (4, None) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a7cdf3-6514-41d1-b456-e10cb1107c44]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[77be022e-5006-4eb4-9f07-fee10e64c20d]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260]
Nov 16 15:35:31 user nova-compute[74658]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260] successful.
Nov 16 15:35:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da1a535-610d-4c57-86de-77c037da2477]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== disconnect_volume: return (306ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:35:31 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Deleting instance files /opt/stack/data/nova/instances/aa513122-cec4-4659-9827-6578827018aa_del
Nov 16 15:35:31 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Deletion of /opt/stack/data/nova/instances/aa513122-cec4-4659-9827-6578827018aa_del complete
Nov 16 15:35:31 user nova-compute[74658]: INFO nova.compute.manager [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: aa513122-cec4-4659-9827-6578827018aa] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: aa513122-cec4-4659-9827-6578827018aa] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Received event network-vif-unplugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] Acquiring lock "aa513122-cec4-4659-9827-6578827018aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] Lock "aa513122-cec4-4659-9827-6578827018aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] Lock "aa513122-cec4-4659-9827-6578827018aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] No waiting events found dispatching network-vif-unplugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Received event network-vif-unplugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Received event network-vif-plugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] Acquiring lock "aa513122-cec4-4659-9827-6578827018aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] Lock "aa513122-cec4-4659-9827-6578827018aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] Lock "aa513122-cec4-4659-9827-6578827018aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] No waiting events found dispatching network-vif-plugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:31 user nova-compute[74658]: WARNING nova.compute.manager [req-c0489761-e5cc-4941-b3a5-80927b35b96e req-1121c8ba-ccca-4438-846d-c63f8e469f22 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Received unexpected event network-vif-plugged-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a for instance with vm_state active and task_state deleting.
Nov 16 15:35:32 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: aa513122-cec4-4659-9827-6578827018aa] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:32 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: aa513122-cec4-4659-9827-6578827018aa] Took 0.78 seconds to deallocate network for instance.
Nov 16 15:35:33 user nova-compute[74658]: INFO nova.compute.manager [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: aa513122-cec4-4659-9827-6578827018aa] Took 0.81 seconds to detach 1 volumes for instance.
Nov 16 15:35:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:33 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:35:33 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:35:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:33 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Deleted allocations for instance aa513122-cec4-4659-9827-6578827018aa
Nov 16 15:35:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-56a79e4a-95ea-4852-ae83-a6745da46eab tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "aa513122-cec4-4659-9827-6578827018aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.164s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-743c0eb0-e074-486f-9985-aea22ebb22cd req-8c397015-8263-45ee-9f0d-7ab7971796d4 service nova] [instance: aa513122-cec4-4659-9827-6578827018aa] Received event network-vif-deleted-c1acc58b-3c96-4d93-bb7c-0d6c55115b1a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:46 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:35:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:46 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:35:46 user nova-compute[74658]: INFO nova.compute.claims [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Claim successful on node user
Nov 16 15:35:46 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:35:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:35:47 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG nova.policy [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f04b6f7159cc4358a2978e9c97aa2dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634ad79271c9408da094067dd3c209d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:35:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Creating image(s)
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "/opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "/opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.165s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.166s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk 1073741824" returned: 0 in 0.056s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Successfully created port: f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:35:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Cannot resize image /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Ensure instance console log exists: /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Successfully updated port: f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquired lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-d8b4337c-b7e7-4717-b980-d12a57584fb8 req-c13b4f81-704f-47bf-a172-2f7eec6b67d2 service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Received event network-changed-f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-d8b4337c-b7e7-4717-b980-d12a57584fb8 req-c13b4f81-704f-47bf-a172-2f7eec6b67d2 service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Refreshing instance network info cache due to event network-changed-f85390fc-0174-409a-93c1-88f17f39eb94. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d8b4337c-b7e7-4717-b980-d12a57584fb8 req-c13b4f81-704f-47bf-a172-2f7eec6b67d2 service nova] Acquiring lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Updating instance_info_cache with network_info: [{"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Releasing lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Instance network_info: |[{"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d8b4337c-b7e7-4717-b980-d12a57584fb8 req-c13b4f81-704f-47bf-a172-2f7eec6b67d2 service nova] Acquired lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.network.neutron [req-d8b4337c-b7e7-4717-b980-d12a57584fb8 req-c13b4f81-704f-47bf-a172-2f7eec6b67d2 service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Refreshing network info cache for port f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Start _get_guest_xml network_info=[{"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:35:48 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:35:48 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-32973506',display_name='tempest-AttachVolumeTestJSON-server-32973506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-32973506',id=36,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2XAa3fCdVzLYCYiGigm2gUTY6u2a2XNf9SGp5OhHG9idibjsWcYWh+xWK64o44LnyizHDQpHWnc5WOWXZdjRVwandS3PhlqFMfOnti7GdzSJqaR1FoALelAIXJVZwhHA==',key_name='tempest-keypair-1325275752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-fgef46m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=bbbdb32b-2c3f-4c2f-9395-9c983242e124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:c0,bridge_name='br-int',has_traffic_filtering=True,id=f85390fc-0174-409a-93c1-88f17f39eb94,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85390fc-01') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.objects.instance [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'pci_devices' on Instance uuid bbbdb32b-2c3f-4c2f-9395-9c983242e124 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:35:48 user nova-compute[74658]:   <uuid>bbbdb32b-2c3f-4c2f-9395-9c983242e124</uuid>
Nov 16 15:35:48 user nova-compute[74658]:   <name>instance-00000024</name>
Nov 16 15:35:48 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:35:48 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:35:48 user nova-compute[74658]:   <metadata>
Nov 16 15:35:48 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:35:48 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:35:48 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeTestJSON-server-32973506</nova:name>
Nov 16 15:35:48 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:35:48</nova:creationTime>
Nov 16 15:35:48 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:35:48 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:35:48 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:35:48 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:35:48 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:35:48 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:35:48 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:35:48 user nova-compute[74658]:       <nova:owner>
Nov 16 15:35:48 user nova-compute[74658]:         <nova:user uuid="f04b6f7159cc4358a2978e9c97aa2dfc">tempest-AttachVolumeTestJSON-1830126630-project-member</nova:user>
Nov 16 15:35:48 user nova-compute[74658]:         <nova:project uuid="634ad79271c9408da094067dd3c209d7">tempest-AttachVolumeTestJSON-1830126630</nova:project>
Nov 16 15:35:48 user nova-compute[74658]:       </nova:owner>
Nov 16 15:35:48 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:35:48 user nova-compute[74658]:       <nova:ports>
Nov 16 15:35:48 user nova-compute[74658]:         <nova:port uuid="f85390fc-0174-409a-93c1-88f17f39eb94">
Nov 16 15:35:48 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 15:35:48 user nova-compute[74658]:         </nova:port>
Nov 16 15:35:48 user nova-compute[74658]:       </nova:ports>
Nov 16 15:35:48 user nova-compute[74658]:     </nova:instance>
Nov 16 15:35:48 user nova-compute[74658]:   </metadata>
Nov 16 15:35:48 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:35:48 user nova-compute[74658]:     <system>
Nov 16 15:35:48 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:35:48 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:35:48 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:35:48 user nova-compute[74658]:       <entry name="serial">bbbdb32b-2c3f-4c2f-9395-9c983242e124</entry>
Nov 16 15:35:48 user nova-compute[74658]:       <entry name="uuid">bbbdb32b-2c3f-4c2f-9395-9c983242e124</entry>
Nov 16 15:35:48 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:35:48 user nova-compute[74658]:     </system>
Nov 16 15:35:48 user nova-compute[74658]:   </sysinfo>
Nov 16 15:35:48 user nova-compute[74658]:   <os>
Nov 16 15:35:48 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:35:48 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:35:48 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:35:48 user nova-compute[74658]:   </os>
Nov 16 15:35:48 user nova-compute[74658]:   <features>
Nov 16 15:35:48 user nova-compute[74658]:     <acpi/>
Nov 16 15:35:48 user nova-compute[74658]:     <apic/>
Nov 16 15:35:48 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:35:48 user nova-compute[74658]:   </features>
Nov 16 15:35:48 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:35:48 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:35:48 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:35:48 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:35:48 user nova-compute[74658]:   </clock>
Nov 16 15:35:48 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:35:48 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:35:48 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:35:48 user nova-compute[74658]:   </cpu>
Nov 16 15:35:48 user nova-compute[74658]:   <devices>
Nov 16 15:35:48 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:35:48 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:35:48 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk"/>
Nov 16 15:35:48 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:35:48 user nova-compute[74658]:     </disk>
Nov 16 15:35:48 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:35:48 user nova-compute[74658]:       <mac address="fa:16:3e:10:18:c0"/>
Nov 16 15:35:48 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:35:48 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:35:48 user nova-compute[74658]:       <target dev="tapf85390fc-01"/>
Nov 16 15:35:48 user nova-compute[74658]:     </interface>
Nov 16 15:35:48 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:35:48 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/console.log" append="off"/>
Nov 16 15:35:48 user nova-compute[74658]:     </serial>
Nov 16 15:35:48 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:35:48 user nova-compute[74658]:     <video>
Nov 16 15:35:48 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:35:48 user nova-compute[74658]:     </video>
Nov 16 15:35:48 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:35:48 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:35:48 user nova-compute[74658]:     </rng>
Nov 16 15:35:48 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:35:48 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:35:48 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:35:48 user nova-compute[74658]:     </memballoon>
Nov 16 15:35:48 user nova-compute[74658]:   </devices>
Nov 16 15:35:48 user nova-compute[74658]: </domain>
Nov 16 15:35:48 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-32973506',display_name='tempest-AttachVolumeTestJSON-server-32973506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-32973506',id=36,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2XAa3fCdVzLYCYiGigm2gUTY6u2a2XNf9SGp5OhHG9idibjsWcYWh+xWK64o44LnyizHDQpHWnc5WOWXZdjRVwandS3PhlqFMfOnti7GdzSJqaR1FoALelAIXJVZwhHA==',key_name='tempest-keypair-1325275752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-fgef46m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=bbbdb32b-2c3f-4c2f-9395-9c983242e124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:c0,bridge_name='br-int',has_traffic_filtering=True,id=f85390fc-0174-409a-93c1-88f17f39eb94,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85390fc-01') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG os_vif [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:c0,bridge_name='br-int',has_traffic_filtering=True,id=f85390fc-0174-409a-93c1-88f17f39eb94,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85390fc-01') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1caa721e-1725-5ba0-ad5b-36420b35c8bd', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf85390fc-01, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf85390fc-01, col_values=(('qos', UUID('3d19afcc-65f1-49c0-82d1-fd225e07d537')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf85390fc-01, col_values=(('external_ids', {'iface-id': 'f85390fc-0174-409a-93c1-88f17f39eb94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:18:c0', 'vm-uuid': 'bbbdb32b-2c3f-4c2f-9395-9c983242e124'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:48 user nova-compute[74658]: INFO os_vif [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:c0,bridge_name='br-int',has_traffic_filtering=True,id=f85390fc-0174-409a-93c1-88f17f39eb94,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85390fc-01')
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:35:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No VIF found with MAC fa:16:3e:10:18:c0, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:35:49 user nova-compute[74658]: DEBUG nova.network.neutron [req-d8b4337c-b7e7-4717-b980-d12a57584fb8 req-c13b4f81-704f-47bf-a172-2f7eec6b67d2 service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Updated VIF entry in instance network info cache for port f85390fc-0174-409a-93c1-88f17f39eb94. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:35:49 user nova-compute[74658]: DEBUG nova.network.neutron [req-d8b4337c-b7e7-4717-b980-d12a57584fb8 req-c13b4f81-704f-47bf-a172-2f7eec6b67d2 service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Updating instance_info_cache with network_info: [{"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d8b4337c-b7e7-4717-b980-d12a57584fb8 req-c13b4f81-704f-47bf-a172-2f7eec6b67d2 service nova] Releasing lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-a07e4fa4-3a85-4086-a674-11c141d7f647 req-6a72a193-266e-47c1-bf8b-7124fb2b1eae service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Received event network-vif-plugged-f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a07e4fa4-3a85-4086-a674-11c141d7f647 req-6a72a193-266e-47c1-bf8b-7124fb2b1eae service nova] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a07e4fa4-3a85-4086-a674-11c141d7f647 req-6a72a193-266e-47c1-bf8b-7124fb2b1eae service nova] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a07e4fa4-3a85-4086-a674-11c141d7f647 req-6a72a193-266e-47c1-bf8b-7124fb2b1eae service nova] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-a07e4fa4-3a85-4086-a674-11c141d7f647 req-6a72a193-266e-47c1-bf8b-7124fb2b1eae service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] No waiting events found dispatching network-vif-plugged-f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:50 user nova-compute[74658]: WARNING nova.compute.manager [req-a07e4fa4-3a85-4086-a674-11c141d7f647 req-6a72a193-266e-47c1-bf8b-7124fb2b1eae service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Received unexpected event network-vif-plugged-f85390fc-0174-409a-93c1-88f17f39eb94 for instance with vm_state building and task_state spawning.
Nov 16 15:35:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:35:52 user nova-compute[74658]: INFO nova.compute.claims [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Claim successful on node user
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:35:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Instance spawned successfully.
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-2a53416f-14d1-403f-9315-e8b484003ef5 req-21a5a855-86a9-47a7-b3b6-987173c75bac service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Received event network-vif-plugged-f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a53416f-14d1-403f-9315-e8b484003ef5 req-21a5a855-86a9-47a7-b3b6-987173c75bac service nova] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a53416f-14d1-403f-9315-e8b484003ef5 req-21a5a855-86a9-47a7-b3b6-987173c75bac service nova] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a53416f-14d1-403f-9315-e8b484003ef5 req-21a5a855-86a9-47a7-b3b6-987173c75bac service nova] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-2a53416f-14d1-403f-9315-e8b484003ef5 req-21a5a855-86a9-47a7-b3b6-987173c75bac service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] No waiting events found dispatching network-vif-plugged-f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:52 user nova-compute[74658]: WARNING nova.compute.manager [req-2a53416f-14d1-403f-9315-e8b484003ef5 req-21a5a855-86a9-47a7-b3b6-987173c75bac service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Received unexpected event network-vif-plugged-f85390fc-0174-409a-93c1-88f17f39eb94 for instance with vm_state building and task_state spawning.
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:35:52 user nova-compute[74658]: INFO nova.compute.manager [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:35:52 user nova-compute[74658]: INFO nova.compute.manager [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Took 5.81 seconds to build instance.
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:35:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c43bbb43-64dc-4360-8f75-8ec9781c80c8 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.914s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.policy [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f6f0cd0dea04b80a446774baf70b89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ceda4e12ea4af5bdcb9f93cae4f24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:35:52 user nova-compute[74658]: INFO nova.virt.block_device [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Booting with volume 94e3c39f-0623-4ee0-bba3-2bed35edf0d6 at /dev/vda
Nov 16 15:35:52 user nova-compute[74658]: DEBUG os_brick.utils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[322ee516-3b5a-4158-a4cf-f1c4a7ddc613]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb958e4-3358-4f92-9780-02c119daf769]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e13ef7-cef0-4787-b981-22deea9d3499]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[498a10bd-db36-4071-887b-22421a1d6af0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:35:52 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:35:52 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a878263a-3bd0-41a9-9ecf-496b183fee06]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG os_brick.utils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:35:52 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating existing volume attachment record: ba59b404-8be7-4161-98a9-e8c5316444c9 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:35:53 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Successfully created port: ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:35:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:53 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Successfully updated port: ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-19f31c0c-146b-461a-bbe2-eede7b1ed9a0 req-5723fce9-e8ce-4937-8a42-d45c0e7c51b3 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-changed-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-19f31c0c-146b-461a-bbe2-eede7b1ed9a0 req-5723fce9-e8ce-4937-8a42-d45c0e7c51b3 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Refreshing instance network info cache due to event network-changed-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-19f31c0c-146b-461a-bbe2-eede7b1ed9a0 req-5723fce9-e8ce-4937-8a42-d45c0e7c51b3 service nova] Acquiring lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-19f31c0c-146b-461a-bbe2-eede7b1ed9a0 req-5723fce9-e8ce-4937-8a42-d45c0e7c51b3 service nova] Acquired lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-19f31c0c-146b-461a-bbe2-eede7b1ed9a0 req-5723fce9-e8ce-4937-8a42-d45c0e7c51b3 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Refreshing network info cache for port ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-19f31c0c-146b-461a-bbe2-eede7b1ed9a0 req-5723fce9-e8ce-4937-8a42-d45c0e7c51b3 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:54 user nova-compute[74658]: INFO nova.compute.manager [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Terminating instance
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.compute.manager [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.network.neutron [req-19f31c0c-146b-461a-bbe2-eede7b1ed9a0 req-5723fce9-e8ce-4937-8a42-d45c0e7c51b3 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-19f31c0c-146b-461a-bbe2-eede7b1ed9a0 req-5723fce9-e8ce-4937-8a42-d45c0e7c51b3 service nova] Releasing lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquired lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-82fbd40d-9087-47b8-ba20-818bc8e6fdd4 req-9f11da0a-4140-4c03-b56e-89d2f2948cea service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-vif-unplugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-82fbd40d-9087-47b8-ba20-818bc8e6fdd4 req-9f11da0a-4140-4c03-b56e-89d2f2948cea service nova] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-82fbd40d-9087-47b8-ba20-818bc8e6fdd4 req-9f11da0a-4140-4c03-b56e-89d2f2948cea service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-82fbd40d-9087-47b8-ba20-818bc8e6fdd4 req-9f11da0a-4140-4c03-b56e-89d2f2948cea service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-82fbd40d-9087-47b8-ba20-818bc8e6fdd4 req-9f11da0a-4140-4c03-b56e-89d2f2948cea service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] No waiting events found dispatching network-vif-unplugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-82fbd40d-9087-47b8-ba20-818bc8e6fdd4 req-9f11da0a-4140-4c03-b56e-89d2f2948cea service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-vif-unplugged-8845dcec-73a4-4fbc-a835-88ced3593d56 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating instance_info_cache with network_info: [{"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Releasing lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Instance network_info: |[{"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:35:54 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Instance destroyed successfully.
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.objects.instance [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lazy-loading 'resources' on Instance uuid ecc12081-92a2-47e0-a885-efd13f9b5965 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-174035878',display_name='tempest-TestMinimumBasicScenario-server-174035878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-174035878',id=32,image_ref='098e0374-5ed5-4205-a769-10246231155b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBIKmwP0Z3hrk2u+0gQzlRnl15DqtD4JoLKfZeH2Yri7kluGPHjzvkxR33OpxHAO4/oNqUyhLh+7S9PevC2gOFslM/ehoL0M8iur8zX2pZwvXOjl+Ob1XoZwm/Ubsgc4w==',key_name='tempest-TestMinimumBasicScenario-1412037814',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:31:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08549dcd4d26408098316f61ca4a6ee2',ramdisk_id='',reservation_id='r-bzp4qcu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='098e0374-5ed5-4205-a769-10246231155b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1910079629',owner_user_name='tempest-TestMinimumBasicScenario-1910079629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:33:16Z,user_data=None,user_id='d3cee7d0742148a1808713d978dbd01b',uuid=ecc12081-92a2-47e0-a885-efd13f9b5965,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converting VIF {"id": "8845dcec-73a4-4fbc-a835-88ced3593d56", "address": "fa:16:3e:04:77:38", "network": {"id": "27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1535467898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08549dcd4d26408098316f61ca4a6ee2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dcec-73", "ovs_interfaceid": "8845dcec-73a4-4fbc-a835-88ced3593d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:77:38,bridge_name='br-int',has_traffic_filtering=True,id=8845dcec-73a4-4fbc-a835-88ced3593d56,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dcec-73') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG os_vif [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:77:38,bridge_name='br-int',has_traffic_filtering=True,id=8845dcec-73a4-4fbc-a835-88ced3593d56,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dcec-73') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8845dcec-73, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c23e925a-463c-4656-b311-fa34010b12f9) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:54 user nova-compute[74658]: INFO os_vif [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:77:38,bridge_name='br-int',has_traffic_filtering=True,id=8845dcec-73a4-4fbc-a835-88ced3593d56,network=Network(27cf1c2a-12d8-4ffc-8426-13e8cb00a5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dcec-73')
Nov 16 15:35:54 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Deleting instance files /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965_del
Nov 16 15:35:55 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Deletion of /opt/stack/data/nova/instances/ecc12081-92a2-47e0-a885-efd13f9b5965_del complete
Nov 16 15:35:55 user nova-compute[74658]: INFO nova.compute.manager [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 15:35:55 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:35:55 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:35:55 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:35:55 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:55 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Took 0.48 seconds to deallocate network for instance.
Nov 16 15:35:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:55 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:35:55 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:35:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:55 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Deleted allocations for instance ecc12081-92a2-47e0-a885-efd13f9b5965
Nov 16 15:35:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-54a4949a-ce49-4c90-9e3a-e8fcf67b5453 tempest-TestMinimumBasicScenario-1910079629 tempest-TestMinimumBasicScenario-1910079629-project-member] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.781s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-0190c84f-f587-418d-82ee-834d6a0cfa6f req-198d7d10-1ee7-4071-bb56-5df958b91da6 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-vif-deleted-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "7ef751d1-099a-4b46-b08d-99929d449ef9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:56 user nova-compute[74658]: INFO nova.compute.manager [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Terminating instance
Nov 16 15:35:56 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-4daf6bee-9faa-4be0-af46-89d85565fb35 req-920ae609-8f12-4f61-bb7f-7e3b116ef5f6 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4daf6bee-9faa-4be0-af46-89d85565fb35 req-920ae609-8f12-4f61-bb7f-7e3b116ef5f6 service nova] Acquiring lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4daf6bee-9faa-4be0-af46-89d85565fb35 req-920ae609-8f12-4f61-bb7f-7e3b116ef5f6 service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4daf6bee-9faa-4be0-af46-89d85565fb35 req-920ae609-8f12-4f61-bb7f-7e3b116ef5f6 service nova] Lock "ecc12081-92a2-47e0-a885-efd13f9b5965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-4daf6bee-9faa-4be0-af46-89d85565fb35 req-920ae609-8f12-4f61-bb7f-7e3b116ef5f6 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] No waiting events found dispatching network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:56 user nova-compute[74658]: WARNING nova.compute.manager [req-4daf6bee-9faa-4be0-af46-89d85565fb35 req-920ae609-8f12-4f61-bb7f-7e3b116ef5f6 service nova] [instance: ecc12081-92a2-47e0-a885-efd13f9b5965] Received unexpected event network-vif-plugged-8845dcec-73a4-4fbc-a835-88ced3593d56 for instance with vm_state deleted and task_state None.
Nov 16 15:35:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-1b0e01f4-0d8c-4134-9c24-5c7e305e3aa4 req-be1c7e4b-c8f0-4d09-bceb-87a3b86f7602 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received event network-vif-unplugged-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1b0e01f4-0d8c-4134-9c24-5c7e305e3aa4 req-be1c7e4b-c8f0-4d09-bceb-87a3b86f7602 service nova] Acquiring lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1b0e01f4-0d8c-4134-9c24-5c7e305e3aa4 req-be1c7e4b-c8f0-4d09-bceb-87a3b86f7602 service nova] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1b0e01f4-0d8c-4134-9c24-5c7e305e3aa4 req-be1c7e4b-c8f0-4d09-bceb-87a3b86f7602 service nova] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-1b0e01f4-0d8c-4134-9c24-5c7e305e3aa4 req-be1c7e4b-c8f0-4d09-bceb-87a3b86f7602 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] No waiting events found dispatching network-vif-unplugged-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-1b0e01f4-0d8c-4134-9c24-5c7e305e3aa4 req-be1c7e4b-c8f0-4d09-bceb-87a3b86f7602 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received event network-vif-unplugged-4999888f-3310-45f7-bc33-8180b8110ef9 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:35:57 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Instance destroyed successfully.
Nov 16 15:35:57 user nova-compute[74658]: DEBUG nova.objects.instance [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lazy-loading 'resources' on Instance uuid 7ef751d1-099a-4b46-b08d-99929d449ef9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-961291666',display_name='tempest-ServerActionsTestOtherA-server-961291666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-961291666',id=1,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfs3x9tKyy9KHJUedCxh49P9LH14YRsacTcDaxEVd8YqO4Cuyb8pJja3XT1OhFAuM946OKuatB2JwDtDIzcfi6ebK97F+SRlzAxuSg9qPWnSDGTyfFCtkcgNG6s/nMQMw==',key_name='tempest-keypair-1686675082',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b189fdeea224d4dbdc2923041dc8e75',ramdisk_id='',reservation_id='r-g481z6r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1362925052',owner_user_name='tempest-ServerActionsTestOtherA-1362925052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8507e72d5b248cd8a6a8b9bea6733cb',uuid=7ef751d1-099a-4b46-b08d-99929d449ef9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converting VIF {"id": "4999888f-3310-45f7-bc33-8180b8110ef9", "address": "fa:16:3e:dc:68:8b", "network": {"id": "5ca21522-c84f-4691-a95a-b10b5251d652", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2038464173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b189fdeea224d4dbdc2923041dc8e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4999888f-33", "ovs_interfaceid": "4999888f-3310-45f7-bc33-8180b8110ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=4999888f-3310-45f7-bc33-8180b8110ef9,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4999888f-33') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG os_vif [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=4999888f-3310-45f7-bc33-8180b8110ef9,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4999888f-33') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4999888f-33, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ece84f9-4e5c-4688-8fde-2d61438ba376) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:57 user nova-compute[74658]: INFO os_vif [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=4999888f-3310-45f7-bc33-8180b8110ef9,network=Network(5ca21522-c84f-4691-a95a-b10b5251d652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4999888f-33')
Nov 16 15:35:57 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Deleting instance files /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9_del
Nov 16 15:35:57 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Deletion of /opt/stack/data/nova/instances/7ef751d1-099a-4b46-b08d-99929d449ef9_del complete
Nov 16 15:35:57 user nova-compute[74658]: INFO nova.compute.manager [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 15:35:57 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:35:57 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Took 0.44 seconds to deallocate network for instance.
Nov 16 15:35:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:35:57 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:58 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Deleted allocations for instance 7ef751d1-099a-4b46-b08d-99929d449ef9
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c31cbf30-befd-47a6-b84c-115627046edf tempest-ServerActionsTestOtherA-1362925052 tempest-ServerActionsTestOtherA-1362925052-project-member] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.750s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:35:58 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Creating image(s)
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Ensure instance console log exists: /opt/stack/data/nova/instances/ad92b41d-2fe6-4e3d-877e-aebf361ddb14/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Start _get_guest_xml network_info=[{"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ba59b404-8be7-4161-98a9-e8c5316444c9', 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZujWacb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad92b41d-2fe6-4e3d-877e-aebf361ddb14', 'attached_at': '', 'detached_at': '', 'volume_id': '94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 'serial': '94e3c39f-0623-4ee0-bba3-2bed35edf0d6'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-875cf46c-60e9-4c98-b04e-8e9711707ca4 req-52193012-345e-4139-86b3-e3a9dedb3485 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received event network-vif-deleted-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:35:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZujWacb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:35:58 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:35:58 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:35:58 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f41e61c-07d7-4410-b48a-7a545741d652]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:35:58 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[af07eb29-c3e2-4b20-8b50-040f779fde0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6] added
Nov 16 15:35:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6983b0d3-77d4-424f-bcac-67911bf9b362]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[144539ff-7405-43a3-9ee7-5e575ea6c3ac]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZujWacb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZujWacb" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd39ad2-2cbb-4b55-9906-b49b5ec765b0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EZujWacb'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[747874b0-ae16-401a-85fc-bb1d573d1f45]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54319ed-6026-42d6-8c51-a97fcb6c358c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:35:58 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:35:58 user nova-compute[74658]:  {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:35:58 user nova-compute[74658]: WARNING os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 15:35:58 user nova-compute[74658]: 
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72f6adb-fa14-48da-9271-5b1195d76090]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260]
Nov 16 15:35:58 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260] successful.
Nov 16 15:35:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0d6996-f97f-46ab-9215-56c17e4afeda]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd288fa9-1abf-4c88-9318-24ecefba2b6d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:35:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:35:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c911c2-7b56-402b-bdb0-e95704a28e26]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZujWacb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-28569801-0ac8-43c2-ac52-24a68a30c592 req-4f8a9231-f3ed-4478-8bb8-545969691246 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received event network-vif-plugged-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28569801-0ac8-43c2-ac52-24a68a30c592 req-4f8a9231-f3ed-4478-8bb8-545969691246 service nova] Acquiring lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28569801-0ac8-43c2-ac52-24a68a30c592 req-4f8a9231-f3ed-4478-8bb8-545969691246 service nova] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28569801-0ac8-43c2-ac52-24a68a30c592 req-4f8a9231-f3ed-4478-8bb8-545969691246 service nova] Lock "7ef751d1-099a-4b46-b08d-99929d449ef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:35:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-28569801-0ac8-43c2-ac52-24a68a30c592 req-4f8a9231-f3ed-4478-8bb8-545969691246 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] No waiting events found dispatching network-vif-plugged-4999888f-3310-45f7-bc33-8180b8110ef9 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:35:58 user nova-compute[74658]: WARNING nova.compute.manager [req-28569801-0ac8-43c2-ac52-24a68a30c592 req-4f8a9231-f3ed-4478-8bb8-545969691246 service nova] [instance: 7ef751d1-099a-4b46-b08d-99929d449ef9] Received unexpected event network-vif-plugged-4999888f-3310-45f7-bc33-8180b8110ef9 for instance with vm_state deleted and task_state None.
Nov 16 15:35:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23235303863626533', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235303863626533', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1301805927',display_name='tempest-TestShelveInstance-server-1301805927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1301805927',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPygr6WU5+gJuACnR5fZxHlm6rFQhOM6IijIWomXPqOXhz63SuWkK3DOw++IKsdq0+FUAHKg11qCi6SrKszbVnBM+8+obzPMY1A4VqSJZrmbboLiW+D8HJUau+NJ7KBcfA==',key_name='tempest-TestShelveInstance-1228229818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61ceda4e12ea4af5bdcb9f93cae4f24c',ramdisk_id='',reservation_id='r-gsvqsadq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-182953903',owner_user_name='tempest-TestShelveInstance-182953903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:35:53Z,user_data=None,user_id='1f6f0cd0dea04b80a446774baf70b89e',uuid=ad92b41d-2fe6-4e3d-877e-aebf361ddb14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converting VIF {"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG nova.objects.instance [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lazy-loading 'pci_devices' on Instance uuid ad92b41d-2fe6-4e3d-877e-aebf361ddb14 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:35:59 user nova-compute[74658]:   <uuid>ad92b41d-2fe6-4e3d-877e-aebf361ddb14</uuid>
Nov 16 15:35:59 user nova-compute[74658]:   <name>instance-00000025</name>
Nov 16 15:35:59 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:35:59 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:35:59 user nova-compute[74658]:   <metadata>
Nov 16 15:35:59 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:35:59 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:35:59 user nova-compute[74658]:       <nova:name>tempest-TestShelveInstance-server-1301805927</nova:name>
Nov 16 15:35:59 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:35:58</nova:creationTime>
Nov 16 15:35:59 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:35:59 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:35:59 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:35:59 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:35:59 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:35:59 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:35:59 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:35:59 user nova-compute[74658]:       <nova:owner>
Nov 16 15:35:59 user nova-compute[74658]:         <nova:user uuid="1f6f0cd0dea04b80a446774baf70b89e">tempest-TestShelveInstance-182953903-project-member</nova:user>
Nov 16 15:35:59 user nova-compute[74658]:         <nova:project uuid="61ceda4e12ea4af5bdcb9f93cae4f24c">tempest-TestShelveInstance-182953903</nova:project>
Nov 16 15:35:59 user nova-compute[74658]:       </nova:owner>
Nov 16 15:35:59 user nova-compute[74658]:       <nova:ports>
Nov 16 15:35:59 user nova-compute[74658]:         <nova:port uuid="ea57a3ae-37e3-4d66-8bf3-177f9303bf4f">
Nov 16 15:35:59 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 15:35:59 user nova-compute[74658]:         </nova:port>
Nov 16 15:35:59 user nova-compute[74658]:       </nova:ports>
Nov 16 15:35:59 user nova-compute[74658]:     </nova:instance>
Nov 16 15:35:59 user nova-compute[74658]:   </metadata>
Nov 16 15:35:59 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:35:59 user nova-compute[74658]:     <system>
Nov 16 15:35:59 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:35:59 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:35:59 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:35:59 user nova-compute[74658]:       <entry name="serial">ad92b41d-2fe6-4e3d-877e-aebf361ddb14</entry>
Nov 16 15:35:59 user nova-compute[74658]:       <entry name="uuid">ad92b41d-2fe6-4e3d-877e-aebf361ddb14</entry>
Nov 16 15:35:59 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:35:59 user nova-compute[74658]:     </system>
Nov 16 15:35:59 user nova-compute[74658]:   </sysinfo>
Nov 16 15:35:59 user nova-compute[74658]:   <os>
Nov 16 15:35:59 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:35:59 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:35:59 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:35:59 user nova-compute[74658]:   </os>
Nov 16 15:35:59 user nova-compute[74658]:   <features>
Nov 16 15:35:59 user nova-compute[74658]:     <acpi/>
Nov 16 15:35:59 user nova-compute[74658]:     <apic/>
Nov 16 15:35:59 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:35:59 user nova-compute[74658]:   </features>
Nov 16 15:35:59 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:35:59 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:35:59 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:35:59 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:35:59 user nova-compute[74658]:   </clock>
Nov 16 15:35:59 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:35:59 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:35:59 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:35:59 user nova-compute[74658]:   </cpu>
Nov 16 15:35:59 user nova-compute[74658]:   <devices>
Nov 16 15:35:59 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:35:59 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:35:59 user nova-compute[74658]:       <source dev="/dev/sdb"/>
Nov 16 15:35:59 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:35:59 user nova-compute[74658]:       <serial>94e3c39f-0623-4ee0-bba3-2bed35edf0d6</serial>
Nov 16 15:35:59 user nova-compute[74658]:     </disk>
Nov 16 15:35:59 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:35:59 user nova-compute[74658]:       <mac address="fa:16:3e:da:f7:24"/>
Nov 16 15:35:59 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:35:59 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:35:59 user nova-compute[74658]:       <target dev="tapea57a3ae-37"/>
Nov 16 15:35:59 user nova-compute[74658]:     </interface>
Nov 16 15:35:59 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:35:59 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/ad92b41d-2fe6-4e3d-877e-aebf361ddb14/console.log" append="off"/>
Nov 16 15:35:59 user nova-compute[74658]:     </serial>
Nov 16 15:35:59 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:35:59 user nova-compute[74658]:     <video>
Nov 16 15:35:59 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:35:59 user nova-compute[74658]:     </video>
Nov 16 15:35:59 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:35:59 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:35:59 user nova-compute[74658]:     </rng>
Nov 16 15:35:59 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:35:59 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:35:59 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:35:59 user nova-compute[74658]:     </memballoon>
Nov 16 15:35:59 user nova-compute[74658]:   </devices>
Nov 16 15:35:59 user nova-compute[74658]: </domain>
Nov 16 15:35:59 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1301805927',display_name='tempest-TestShelveInstance-server-1301805927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1301805927',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPygr6WU5+gJuACnR5fZxHlm6rFQhOM6IijIWomXPqOXhz63SuWkK3DOw++IKsdq0+FUAHKg11qCi6SrKszbVnBM+8+obzPMY1A4VqSJZrmbboLiW+D8HJUau+NJ7KBcfA==',key_name='tempest-TestShelveInstance-1228229818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61ceda4e12ea4af5bdcb9f93cae4f24c',ramdisk_id='',reservation_id='r-gsvqsadq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-182953903',owner_user_name='tempest-TestShelveInstance-182953903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:35:53Z,user_data=None,user_id='1f6f0cd0dea04b80a446774baf70b89e',uuid=ad92b41d-2fe6-4e3d-877e-aebf361ddb14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converting VIF {"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG os_vif [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28540692-2c11-59a5-aa7f-ea53e606a022', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea57a3ae-37, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea57a3ae-37, col_values=(('qos', UUID('27aafac5-fe5c-4411-ae76-d9daa3c5958f')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea57a3ae-37, col_values=(('external_ids', {'iface-id': 'ea57a3ae-37e3-4d66-8bf3-177f9303bf4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:f7:24', 'vm-uuid': 'ad92b41d-2fe6-4e3d-877e-aebf361ddb14'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:35:59 user nova-compute[74658]: INFO os_vif [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37')
Nov 16 15:35:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:35:59 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] No VIF found with MAC fa:16:3e:da:f7:24, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:36:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-9f09106c-7bcc-4caf-9852-a3b6c2319345 req-696149ac-7cf7-4f54-8512-3f62d034b7e6 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:36:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9f09106c-7bcc-4caf-9852-a3b6c2319345 req-696149ac-7cf7-4f54-8512-3f62d034b7e6 service nova] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9f09106c-7bcc-4caf-9852-a3b6c2319345 req-696149ac-7cf7-4f54-8512-3f62d034b7e6 service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9f09106c-7bcc-4caf-9852-a3b6c2319345 req-696149ac-7cf7-4f54-8512-3f62d034b7e6 service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-9f09106c-7bcc-4caf-9852-a3b6c2319345 req-696149ac-7cf7-4f54-8512-3f62d034b7e6 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] No waiting events found dispatching network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:36:00 user nova-compute[74658]: WARNING nova.compute.manager [req-9f09106c-7bcc-4caf-9852-a3b6c2319345 req-696149ac-7cf7-4f54-8512-3f62d034b7e6 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received unexpected event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f for instance with vm_state building and task_state spawning.
Nov 16 15:36:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:36:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:36:02 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Instance spawned successfully.
Nov 16 15:36:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:36:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:02 user nova-compute[74658]: INFO nova.compute.manager [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 16 15:36:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:36:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-049a30c5-a15f-401b-8f59-4c8b6f69f87e req-5e3943aa-5389-4598-83a9-81f94566dfb6 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:36:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-049a30c5-a15f-401b-8f59-4c8b6f69f87e req-5e3943aa-5389-4598-83a9-81f94566dfb6 service nova] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-049a30c5-a15f-401b-8f59-4c8b6f69f87e req-5e3943aa-5389-4598-83a9-81f94566dfb6 service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-049a30c5-a15f-401b-8f59-4c8b6f69f87e req-5e3943aa-5389-4598-83a9-81f94566dfb6 service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-049a30c5-a15f-401b-8f59-4c8b6f69f87e req-5e3943aa-5389-4598-83a9-81f94566dfb6 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] No waiting events found dispatching network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:36:03 user nova-compute[74658]: WARNING nova.compute.manager [req-049a30c5-a15f-401b-8f59-4c8b6f69f87e req-5e3943aa-5389-4598-83a9-81f94566dfb6 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received unexpected event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f for instance with vm_state building and task_state spawning.
Nov 16 15:36:03 user nova-compute[74658]: INFO nova.compute.manager [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Took 10.95 seconds to build instance.
Nov 16 15:36:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c0153a26-7d23-43f9-8d10-9bf18796bbd7 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.043s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-0f66aa5b-bfe7-4621-94df-99959c2375d6 req-5a4d74d3-9c30-4306-a33a-4036e3028542 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-changed-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:36:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-0f66aa5b-bfe7-4621-94df-99959c2375d6 req-5a4d74d3-9c30-4306-a33a-4036e3028542 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Refreshing instance network info cache due to event network-changed-5c27e2c4-4109-4450-ab40-70fbd6056674. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:36:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f66aa5b-bfe7-4621-94df-99959c2375d6 req-5a4d74d3-9c30-4306-a33a-4036e3028542 service nova] Acquiring lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:36:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f66aa5b-bfe7-4621-94df-99959c2375d6 req-5a4d74d3-9c30-4306-a33a-4036e3028542 service nova] Acquired lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:36:05 user nova-compute[74658]: DEBUG nova.network.neutron [req-0f66aa5b-bfe7-4621-94df-99959c2375d6 req-5a4d74d3-9c30-4306-a33a-4036e3028542 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Refreshing network info cache for port 5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:36:05 user nova-compute[74658]: DEBUG nova.network.neutron [req-0f66aa5b-bfe7-4621-94df-99959c2375d6 req-5a4d74d3-9c30-4306-a33a-4036e3028542 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updated VIF entry in instance network info cache for port 5c27e2c4-4109-4450-ab40-70fbd6056674. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:36:05 user nova-compute[74658]: DEBUG nova.network.neutron [req-0f66aa5b-bfe7-4621-94df-99959c2375d6 req-5a4d74d3-9c30-4306-a33a-4036e3028542 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updating instance_info_cache with network_info: [{"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:36:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f66aa5b-bfe7-4621-94df-99959c2375d6 req-5a4d74d3-9c30-4306-a33a-4036e3028542 service nova] Releasing lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:36:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:07 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:36:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:36:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:36:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:36:07 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:36:07 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updating instance_info_cache with network_info: [{"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:36:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:36:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:36:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:36:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:08 user nova-compute[74658]: INFO nova.compute.manager [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Shelving
Nov 16 15:36:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:36:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-6f8f9629-1933-4faf-9d68-f4f1d09207f8 req-c1e6409a-8e2e-4920-895e-792e6003bdec service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-vif-unplugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:36:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6f8f9629-1933-4faf-9d68-f4f1d09207f8 req-c1e6409a-8e2e-4920-895e-792e6003bdec service nova] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6f8f9629-1933-4faf-9d68-f4f1d09207f8 req-c1e6409a-8e2e-4920-895e-792e6003bdec service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6f8f9629-1933-4faf-9d68-f4f1d09207f8 req-c1e6409a-8e2e-4920-895e-792e6003bdec service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-6f8f9629-1933-4faf-9d68-f4f1d09207f8 req-c1e6409a-8e2e-4920-895e-792e6003bdec service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] No waiting events found dispatching network-vif-unplugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:36:09 user nova-compute[74658]: WARNING nova.compute.manager [req-6f8f9629-1933-4faf-9d68-f4f1d09207f8 req-c1e6409a-8e2e-4920-895e-792e6003bdec service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received unexpected event network-vif-unplugged-5c27e2c4-4109-4450-ab40-70fbd6056674 for instance with vm_state active and task_state shelving.
Nov 16 15:36:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Instance destroyed successfully.
Nov 16 15:36:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Beginning cold snapshot process
Nov 16 15:36:09 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:36:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk /opt/stack/data/nova/instances/snapshots/tmp4z5t0vl9/423cf5e41ede4794948fae54aa8aa2ca {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk /opt/stack/data/nova/instances/snapshots/tmp4z5t0vl9/423cf5e41ede4794948fae54aa8aa2ca" returned: 0 in 0.555s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Snapshot extracted, beginning image upload
Nov 16 15:36:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:10 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-07e0be33-2b2a-46a5-8499-3becfe316398 req-2376c330-01c7-4fa2-b39e-32bdad18dc5e service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-07e0be33-2b2a-46a5-8499-3becfe316398 req-2376c330-01c7-4fa2-b39e-32bdad18dc5e service nova] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-07e0be33-2b2a-46a5-8499-3becfe316398 req-2376c330-01c7-4fa2-b39e-32bdad18dc5e service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-07e0be33-2b2a-46a5-8499-3becfe316398 req-2376c330-01c7-4fa2-b39e-32bdad18dc5e service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-07e0be33-2b2a-46a5-8499-3becfe316398 req-2376c330-01c7-4fa2-b39e-32bdad18dc5e service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] No waiting events found dispatching network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:36:11 user nova-compute[74658]: WARNING nova.compute.manager [req-07e0be33-2b2a-46a5-8499-3becfe316398 req-2376c330-01c7-4fa2-b39e-32bdad18dc5e service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received unexpected event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 15:36:11 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:36:11 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:36:11 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8583MB free_disk=25.388744354248047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 396c5838-c4aa-4b02-9b9a-4f3296d85f2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ad92b41d-2fe6-4e3d-877e-aebf361ddb14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:36:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:12 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Snapshot image upload complete
Nov 16 15:36:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:36:12 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:36:12 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:36:12 user nova-compute[74658]: INFO nova.compute.manager [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Shelve offloading
Nov 16 15:36:12 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Instance destroyed successfully.
Nov 16 15:36:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:36:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:36:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquired lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:36:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updating instance_info_cache with network_info: [{"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Releasing lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:36:13 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Instance destroyed successfully.
Nov 16 15:36:13 user nova-compute[74658]: DEBUG nova.objects.instance [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'resources' on Instance uuid 396c5838-c4aa-4b02-9b9a-4f3296d85f2f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819937516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819937516',id=35,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfL30sylCzE4s7OaXUClxC/TLYSq+AkJw/cWYRvMCdN4KQS+9zm2S6f+A44zBkMEc4KoIAqpRUwHpjOnbCAuCPYrfLP0yUjLu5Mku/PeEcuRZ25l/ImXz70q859U/8ahQ==',key_name='tempest-keypair-1533894978',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:34:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-vav0s65l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member',shelved_at='2023-11-16T15:36:12.805873',shelved_host='user',shelved_image_id='cbf34948-773c-481f-a4cd-891e7ff10f21'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=396c5838-c4aa-4b02-9b9a-4f3296d85f2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG os_vif [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c27e2c4-41, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-90d657f8-89c9-4e30-b4c4-00b489fa085d req-ae5fe906-da66-427b-8b38-a8dc79966cd8 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-changed-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-90d657f8-89c9-4e30-b4c4-00b489fa085d req-ae5fe906-da66-427b-8b38-a8dc79966cd8 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Refreshing instance network info cache due to event network-changed-5c27e2c4-4109-4450-ab40-70fbd6056674. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-90d657f8-89c9-4e30-b4c4-00b489fa085d req-ae5fe906-da66-427b-8b38-a8dc79966cd8 service nova] Acquiring lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-90d657f8-89c9-4e30-b4c4-00b489fa085d req-ae5fe906-da66-427b-8b38-a8dc79966cd8 service nova] Acquired lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-90d657f8-89c9-4e30-b4c4-00b489fa085d req-ae5fe906-da66-427b-8b38-a8dc79966cd8 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Refreshing network info cache for port 5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c92001c4-bdd1-4583-b96c-d832c91e10a1) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:36:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:36:13 user nova-compute[74658]: INFO os_vif [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41')
Nov 16 15:36:13 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Deleting instance files /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f_del
Nov 16 15:36:13 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Deletion of /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f_del complete
Nov 16 15:36:13 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Deleted allocations for instance 396c5838-c4aa-4b02-9b9a-4f3296d85f2f
Nov 16 15:36:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG nova.objects.instance [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'numa_topology' on Instance uuid 396c5838-c4aa-4b02-9b9a-4f3296d85f2f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG nova.objects.base [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Object Instance<396c5838-c4aa-4b02-9b9a-4f3296d85f2f> lazy-loaded attributes: resources,numa_topology {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3b0b46f3-7a85-4a92-9394-e831b7f1c086 tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.411s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-90d657f8-89c9-4e30-b4c4-00b489fa085d req-ae5fe906-da66-427b-8b38-a8dc79966cd8 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updated VIF entry in instance network info cache for port 5c27e2c4-4109-4450-ab40-70fbd6056674. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-90d657f8-89c9-4e30-b4c4-00b489fa085d req-ae5fe906-da66-427b-8b38-a8dc79966cd8 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updating instance_info_cache with network_info: [{"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:36:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-90d657f8-89c9-4e30-b4c4-00b489fa085d req-ae5fe906-da66-427b-8b38-a8dc79966cd8 service nova] Releasing lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:36:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:17 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:36:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "459a4296-6338-49d3-a3ba-f881418f9d7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:36:22 user nova-compute[74658]: INFO nova.compute.claims [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Claim successful on node user
Nov 16 15:36:22 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:36:22 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:36:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG nova.policy [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aed7ea9505b3400ebbe1ce456419bc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2156886e7c2247e38a1ffe4025798a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:36:22 user nova-compute[74658]: INFO nova.virt.block_device [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Booting with volume 35afd958-7ad4-4133-8bfa-bfccac228014 at /dev/vda
Nov 16 15:36:22 user nova-compute[74658]: DEBUG os_brick.utils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[925b4476-9920-4e9a-9c1f-f2f72897410e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[73298efb-e791-432a-9649-4e705c7b2f98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc632eb-1422-463e-bfb3-69f81c99e1e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4abc76-78c6-450e-ba4b-2e790e15e63d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:36:22 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:36:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[871be86d-108a-4f4d-8cdb-10d9a769b742]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG os_brick.utils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:36:22 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Updating existing volume attachment record: 5e285fef-23fe-4d01-9d7d-17bc51ee8b13 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:36:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Successfully created port: 62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:36:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Successfully updated port: 62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:36:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:36:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquired lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:36:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:36:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-fe20bcb0-9d0b-4f5e-be67-78376a8d37aa req-f2d6562c-4f5b-42e7-9573-7541c051b14d service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received event network-changed-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:36:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-fe20bcb0-9d0b-4f5e-be67-78376a8d37aa req-f2d6562c-4f5b-42e7-9573-7541c051b14d service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Refreshing instance network info cache due to event network-changed-62eaa972-e599-49b6-8310-3872c69febdd. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:36:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fe20bcb0-9d0b-4f5e-be67-78376a8d37aa req-f2d6562c-4f5b-42e7-9573-7541c051b14d service nova] Acquiring lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:36:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:36:24 user nova-compute[74658]: DEBUG nova.network.neutron [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Updating instance_info_cache with network_info: [{"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:36:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Releasing lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:36:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Instance network_info: |[{"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:36:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fe20bcb0-9d0b-4f5e-be67-78376a8d37aa req-f2d6562c-4f5b-42e7-9573-7541c051b14d service nova] Acquired lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:36:24 user nova-compute[74658]: DEBUG nova.network.neutron [req-fe20bcb0-9d0b-4f5e-be67-78376a8d37aa req-f2d6562c-4f5b-42e7-9573-7541c051b14d service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Refreshing network info cache for port 62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:36:24 user nova-compute[74658]: DEBUG nova.network.neutron [req-fe20bcb0-9d0b-4f5e-be67-78376a8d37aa req-f2d6562c-4f5b-42e7-9573-7541c051b14d service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Updated VIF entry in instance network info cache for port 62eaa972-e599-49b6-8310-3872c69febdd. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:36:24 user nova-compute[74658]: DEBUG nova.network.neutron [req-fe20bcb0-9d0b-4f5e-be67-78376a8d37aa req-f2d6562c-4f5b-42e7-9573-7541c051b14d service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Updating instance_info_cache with network_info: [{"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:36:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fe20bcb0-9d0b-4f5e-be67-78376a8d37aa req-f2d6562c-4f5b-42e7-9573-7541c051b14d service nova] Releasing lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:36:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:36:27 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Creating image(s)
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Ensure instance console log exists: /opt/stack/data/nova/instances/459a4296-6338-49d3-a3ba-f881418f9d7c/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Start _get_guest_xml network_info=[{"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5e285fef-23fe-4d01-9d7d-17bc51ee8b13', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJDPvkmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '459a4296-6338-49d3-a3ba-f881418f9d7c', 'attached_at': '', 'detached_at': '', 'volume_id': '35afd958-7ad4-4133-8bfa-bfccac228014', 'serial': '35afd958-7ad4-4133-8bfa-bfccac228014'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:36:27 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:36:27 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJDPvkmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:36:27 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:36:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:36:27 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:36:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:36:27 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:36:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[29711632-069b-4cda-882f-f09a31dfc6a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:36:27 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3056fd-8596-4339-ac15-6e06dee7964d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014] added
Nov 16 15:36:27 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:36:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[26750530-b690-4d56-86d6-60b4f86b04d1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c0853c-4b6a-4e06-994f-6594771edf92]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJDPvkmV {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJDPvkmV" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10d0db7-e8e8-4b8f-b6b0-e2adeed8957e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FJDPvkmV'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65c0110-61f4-410c-a079-2ffad6182711]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0abb8b-0af7-4871-a2b9-dcf24280ce9e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:36:28 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:36:28 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3827c0-336d-4b3e-9dab-f173b7069496]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260]
Nov 16 15:36:28 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260] successful.
Nov 16 15:36:28 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f319e93-20d2-4946-9a2f-46a877917f18]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20aab99-60e7-4ec0-aadf-35e500b2841c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:36:28 user nova-compute[74658]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:36:28 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:36:28 user nova-compute[74658]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:36:28 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e820e960-f1c0-4ece-b2ad-20f6f03ca1a7]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:36:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJDPvkmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23238616332383661', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238616332383661', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-860938395',display_name='tempest-TestVolumeBootPattern-server-860938395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-860938395',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa3gqCorV1WbIg5i//0wnlopR+3KlyeNwvcR7SHxTAoz1md6ZPUq6Nr5c+6nYZB4Ns6g0kjBKvILHRe+adcrSzLJ8v98clK+l5Pw4QpWw7oSlS+Kt7nCSty+cuvnOaubg==',key_name='tempest-TestVolumeBootPattern-1945158636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-drzovq4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:36:23Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=459a4296-6338-49d3-a3ba-f881418f9d7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=62eaa972-e599-49b6-8310-3872c69febdd,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eaa972-e5') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG nova.objects.instance [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'pci_devices' on Instance uuid 459a4296-6338-49d3-a3ba-f881418f9d7c {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:36:29 user nova-compute[74658]:   <uuid>459a4296-6338-49d3-a3ba-f881418f9d7c</uuid>
Nov 16 15:36:29 user nova-compute[74658]:   <name>instance-00000026</name>
Nov 16 15:36:29 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:36:29 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:36:29 user nova-compute[74658]:   <metadata>
Nov 16 15:36:29 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:36:29 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:36:29 user nova-compute[74658]:       <nova:name>tempest-TestVolumeBootPattern-server-860938395</nova:name>
Nov 16 15:36:29 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:36:27</nova:creationTime>
Nov 16 15:36:29 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:36:29 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:36:29 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:36:29 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:36:29 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:36:29 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:36:29 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:36:29 user nova-compute[74658]:       <nova:owner>
Nov 16 15:36:29 user nova-compute[74658]:         <nova:user uuid="aed7ea9505b3400ebbe1ce456419bc82">tempest-TestVolumeBootPattern-1853010836-project-member</nova:user>
Nov 16 15:36:29 user nova-compute[74658]:         <nova:project uuid="2156886e7c2247e38a1ffe4025798a96">tempest-TestVolumeBootPattern-1853010836</nova:project>
Nov 16 15:36:29 user nova-compute[74658]:       </nova:owner>
Nov 16 15:36:29 user nova-compute[74658]:       <nova:ports>
Nov 16 15:36:29 user nova-compute[74658]:         <nova:port uuid="62eaa972-e599-49b6-8310-3872c69febdd">
Nov 16 15:36:29 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 15:36:29 user nova-compute[74658]:         </nova:port>
Nov 16 15:36:29 user nova-compute[74658]:       </nova:ports>
Nov 16 15:36:29 user nova-compute[74658]:     </nova:instance>
Nov 16 15:36:29 user nova-compute[74658]:   </metadata>
Nov 16 15:36:29 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:36:29 user nova-compute[74658]:     <system>
Nov 16 15:36:29 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:36:29 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:36:29 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:36:29 user nova-compute[74658]:       <entry name="serial">459a4296-6338-49d3-a3ba-f881418f9d7c</entry>
Nov 16 15:36:29 user nova-compute[74658]:       <entry name="uuid">459a4296-6338-49d3-a3ba-f881418f9d7c</entry>
Nov 16 15:36:29 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:36:29 user nova-compute[74658]:     </system>
Nov 16 15:36:29 user nova-compute[74658]:   </sysinfo>
Nov 16 15:36:29 user nova-compute[74658]:   <os>
Nov 16 15:36:29 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:36:29 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:36:29 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:36:29 user nova-compute[74658]:   </os>
Nov 16 15:36:29 user nova-compute[74658]:   <features>
Nov 16 15:36:29 user nova-compute[74658]:     <acpi/>
Nov 16 15:36:29 user nova-compute[74658]:     <apic/>
Nov 16 15:36:29 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:36:29 user nova-compute[74658]:   </features>
Nov 16 15:36:29 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:36:29 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:36:29 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:36:29 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:36:29 user nova-compute[74658]:   </clock>
Nov 16 15:36:29 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:36:29 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:36:29 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:36:29 user nova-compute[74658]:   </cpu>
Nov 16 15:36:29 user nova-compute[74658]:   <devices>
Nov 16 15:36:29 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:36:29 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:36:29 user nova-compute[74658]:       <source dev="/dev/sdc"/>
Nov 16 15:36:29 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:36:29 user nova-compute[74658]:       <serial>35afd958-7ad4-4133-8bfa-bfccac228014</serial>
Nov 16 15:36:29 user nova-compute[74658]:     </disk>
Nov 16 15:36:29 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:36:29 user nova-compute[74658]:       <mac address="fa:16:3e:01:8b:e9"/>
Nov 16 15:36:29 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:36:29 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:36:29 user nova-compute[74658]:       <target dev="tap62eaa972-e5"/>
Nov 16 15:36:29 user nova-compute[74658]:     </interface>
Nov 16 15:36:29 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:36:29 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/459a4296-6338-49d3-a3ba-f881418f9d7c/console.log" append="off"/>
Nov 16 15:36:29 user nova-compute[74658]:     </serial>
Nov 16 15:36:29 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:36:29 user nova-compute[74658]:     <video>
Nov 16 15:36:29 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:36:29 user nova-compute[74658]:     </video>
Nov 16 15:36:29 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:36:29 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:36:29 user nova-compute[74658]:     </rng>
Nov 16 15:36:29 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:36:29 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:36:29 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:36:29 user nova-compute[74658]:     </memballoon>
Nov 16 15:36:29 user nova-compute[74658]:   </devices>
Nov 16 15:36:29 user nova-compute[74658]: </domain>
Nov 16 15:36:29 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-860938395',display_name='tempest-TestVolumeBootPattern-server-860938395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-860938395',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa3gqCorV1WbIg5i//0wnlopR+3KlyeNwvcR7SHxTAoz1md6ZPUq6Nr5c+6nYZB4Ns6g0kjBKvILHRe+adcrSzLJ8v98clK+l5Pw4QpWw7oSlS+Kt7nCSty+cuvnOaubg==',key_name='tempest-TestVolumeBootPattern-1945158636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-drzovq4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:36:23Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=459a4296-6338-49d3-a3ba-f881418f9d7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=62eaa972-e599-49b6-8310-3872c69febdd,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eaa972-e5') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG os_vif [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=62eaa972-e599-49b6-8310-3872c69febdd,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eaa972-e5') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c4ec9f3-e2c2-5bb5-96d1-7d22eca42115', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62eaa972-e5, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62eaa972-e5, col_values=(('qos', UUID('4e01eb21-5d85-4dc0-8e00-4a9b96170132')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62eaa972-e5, col_values=(('external_ids', {'iface-id': '62eaa972-e599-49b6-8310-3872c69febdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:8b:e9', 'vm-uuid': '459a4296-6338-49d3-a3ba-f881418f9d7c'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:29 user nova-compute[74658]: INFO os_vif [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=62eaa972-e599-49b6-8310-3872c69febdd,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eaa972-e5')
Nov 16 15:36:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:36:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No VIF found with MAC fa:16:3e:01:8b:e9, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:36:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-83685b10-3d4c-4ecd-bb8d-40eeb8b9b970 req-372cee66-203a-468c-84b3-ba94d67bc875 service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received event network-vif-plugged-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:36:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83685b10-3d4c-4ecd-bb8d-40eeb8b9b970 req-372cee66-203a-468c-84b3-ba94d67bc875 service nova] Acquiring lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83685b10-3d4c-4ecd-bb8d-40eeb8b9b970 req-372cee66-203a-468c-84b3-ba94d67bc875 service nova] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83685b10-3d4c-4ecd-bb8d-40eeb8b9b970 req-372cee66-203a-468c-84b3-ba94d67bc875 service nova] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-83685b10-3d4c-4ecd-bb8d-40eeb8b9b970 req-372cee66-203a-468c-84b3-ba94d67bc875 service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] No waiting events found dispatching network-vif-plugged-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:36:31 user nova-compute[74658]: WARNING nova.compute.manager [req-83685b10-3d4c-4ecd-bb8d-40eeb8b9b970 req-372cee66-203a-468c-84b3-ba94d67bc875 service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received unexpected event network-vif-plugged-62eaa972-e599-49b6-8310-3872c69febdd for instance with vm_state building and task_state spawning.
Nov 16 15:36:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:36:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:36:32 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Instance spawned successfully.
Nov 16 15:36:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:36:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:36:32 user nova-compute[74658]: INFO nova.compute.manager [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 16 15:36:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:36:32 user nova-compute[74658]: INFO nova.compute.manager [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Took 10.87 seconds to build instance.
Nov 16 15:36:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d40797d9-a700-4da9-8395-071d1798a1ac tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.976s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-070bdae8-8a88-46c7-bffe-fc6080e11df3 req-1b527794-c686-4907-a093-c78887d26863 service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received event network-vif-plugged-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:36:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-070bdae8-8a88-46c7-bffe-fc6080e11df3 req-1b527794-c686-4907-a093-c78887d26863 service nova] Acquiring lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-070bdae8-8a88-46c7-bffe-fc6080e11df3 req-1b527794-c686-4907-a093-c78887d26863 service nova] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-070bdae8-8a88-46c7-bffe-fc6080e11df3 req-1b527794-c686-4907-a093-c78887d26863 service nova] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-070bdae8-8a88-46c7-bffe-fc6080e11df3 req-1b527794-c686-4907-a093-c78887d26863 service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] No waiting events found dispatching network-vif-plugged-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:36:33 user nova-compute[74658]: WARNING nova.compute.manager [req-070bdae8-8a88-46c7-bffe-fc6080e11df3 req-1b527794-c686-4907-a093-c78887d26863 service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received unexpected event network-vif-plugged-62eaa972-e599-49b6-8310-3872c69febdd for instance with vm_state active and task_state None.
Nov 16 15:36:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:36:59 user nova-compute[74658]: INFO nova.compute.claims [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Claim successful on node user
Nov 16 15:36:59 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:36:59 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:36:59 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:36:59 user nova-compute[74658]: DEBUG nova.policy [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a638862f3424fda9cd0a29b76596857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681f27eda6c74c20be18669837ace195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:37:00 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Creating image(s)
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "/opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.193s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk 1073741824" returned: 0 in 0.057s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:37:00 user nova-compute[74658]: INFO nova.compute.claims [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Claim successful on node user
Nov 16 15:37:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.221s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Successfully created port: 2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Cannot resize image /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Ensure instance console log exists: /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:37:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.policy [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a638862f3424fda9cd0a29b76596857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681f27eda6c74c20be18669837ace195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:37:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Creating image(s)
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Successfully updated port: 2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquired lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-57a1dea0-993d-4f30-b4f3-7e0448c20a5f req-39172eb3-4bac-4036-adcd-345210e91b8d service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-changed-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-57a1dea0-993d-4f30-b4f3-7e0448c20a5f req-39172eb3-4bac-4036-adcd-345210e91b8d service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Refreshing instance network info cache due to event network-changed-2b2a7adb-93ed-409e-af90-6c594f623c07. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-57a1dea0-993d-4f30-b4f3-7e0448c20a5f req-39172eb3-4bac-4036-adcd-345210e91b8d service nova] Acquiring lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.195s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk 1073741824" returned: 0 in 0.072s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Successfully created port: ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.201s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updating instance_info_cache with network_info: [{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Releasing lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Instance network_info: |[{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-57a1dea0-993d-4f30-b4f3-7e0448c20a5f req-39172eb3-4bac-4036-adcd-345210e91b8d service nova] Acquired lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-57a1dea0-993d-4f30-b4f3-7e0448c20a5f req-39172eb3-4bac-4036-adcd-345210e91b8d service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Refreshing network info cache for port 2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:37:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Start _get_guest_xml network_info=[{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:37:02 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:37:02 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Cannot resize image /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Ensure instance console log exists: /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-120537023',display_name='tempest-ServerRescueNegativeTestJSON-server-120537023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-120537023',id=39,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-0q0axze3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:37:00Z,user_data=None,user_id='9a638862f3424fda9cd0a29b76596857',uuid=82b619d5-e9e6-4e01-83f6-813de238bd5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:5d:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b2a7adb-93ed-409e-af90-6c594f623c07,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2a7adb-93') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'pci_devices' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:37:02 user nova-compute[74658]:   <uuid>82b619d5-e9e6-4e01-83f6-813de238bd5a</uuid>
Nov 16 15:37:02 user nova-compute[74658]:   <name>instance-00000027</name>
Nov 16 15:37:02 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:37:02 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:37:02 user nova-compute[74658]:   <metadata>
Nov 16 15:37:02 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:37:02 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:37:02 user nova-compute[74658]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-120537023</nova:name>
Nov 16 15:37:02 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:37:02</nova:creationTime>
Nov 16 15:37:02 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:37:02 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:37:02 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:37:02 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:37:02 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:37:02 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:37:02 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:37:02 user nova-compute[74658]:       <nova:owner>
Nov 16 15:37:02 user nova-compute[74658]:         <nova:user uuid="9a638862f3424fda9cd0a29b76596857">tempest-ServerRescueNegativeTestJSON-1957488214-project-member</nova:user>
Nov 16 15:37:02 user nova-compute[74658]:         <nova:project uuid="681f27eda6c74c20be18669837ace195">tempest-ServerRescueNegativeTestJSON-1957488214</nova:project>
Nov 16 15:37:02 user nova-compute[74658]:       </nova:owner>
Nov 16 15:37:02 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:37:02 user nova-compute[74658]:       <nova:ports>
Nov 16 15:37:02 user nova-compute[74658]:         <nova:port uuid="2b2a7adb-93ed-409e-af90-6c594f623c07">
Nov 16 15:37:02 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 15:37:02 user nova-compute[74658]:         </nova:port>
Nov 16 15:37:02 user nova-compute[74658]:       </nova:ports>
Nov 16 15:37:02 user nova-compute[74658]:     </nova:instance>
Nov 16 15:37:02 user nova-compute[74658]:   </metadata>
Nov 16 15:37:02 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:37:02 user nova-compute[74658]:     <system>
Nov 16 15:37:02 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:37:02 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:37:02 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:37:02 user nova-compute[74658]:       <entry name="serial">82b619d5-e9e6-4e01-83f6-813de238bd5a</entry>
Nov 16 15:37:02 user nova-compute[74658]:       <entry name="uuid">82b619d5-e9e6-4e01-83f6-813de238bd5a</entry>
Nov 16 15:37:02 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:37:02 user nova-compute[74658]:     </system>
Nov 16 15:37:02 user nova-compute[74658]:   </sysinfo>
Nov 16 15:37:02 user nova-compute[74658]:   <os>
Nov 16 15:37:02 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:37:02 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:37:02 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:37:02 user nova-compute[74658]:   </os>
Nov 16 15:37:02 user nova-compute[74658]:   <features>
Nov 16 15:37:02 user nova-compute[74658]:     <acpi/>
Nov 16 15:37:02 user nova-compute[74658]:     <apic/>
Nov 16 15:37:02 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:37:02 user nova-compute[74658]:   </features>
Nov 16 15:37:02 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:37:02 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:37:02 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:37:02 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:37:02 user nova-compute[74658]:   </clock>
Nov 16 15:37:02 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:37:02 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:37:02 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:37:02 user nova-compute[74658]:   </cpu>
Nov 16 15:37:02 user nova-compute[74658]:   <devices>
Nov 16 15:37:02 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:37:02 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:37:02 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk"/>
Nov 16 15:37:02 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:37:02 user nova-compute[74658]:     </disk>
Nov 16 15:37:02 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:37:02 user nova-compute[74658]:       <mac address="fa:16:3e:a3:5d:6c"/>
Nov 16 15:37:02 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:37:02 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:37:02 user nova-compute[74658]:       <target dev="tap2b2a7adb-93"/>
Nov 16 15:37:02 user nova-compute[74658]:     </interface>
Nov 16 15:37:02 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:37:02 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/console.log" append="off"/>
Nov 16 15:37:02 user nova-compute[74658]:     </serial>
Nov 16 15:37:02 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:37:02 user nova-compute[74658]:     <video>
Nov 16 15:37:02 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:37:02 user nova-compute[74658]:     </video>
Nov 16 15:37:02 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:37:02 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:37:02 user nova-compute[74658]:     </rng>
Nov 16 15:37:02 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:37:02 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:37:02 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:37:02 user nova-compute[74658]:     </memballoon>
Nov 16 15:37:02 user nova-compute[74658]:   </devices>
Nov 16 15:37:02 user nova-compute[74658]: </domain>
Nov 16 15:37:02 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-120537023',display_name='tempest-ServerRescueNegativeTestJSON-server-120537023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-120537023',id=39,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-0q0axze3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:37:00Z,user_data=None,user_id='9a638862f3424fda9cd0a29b76596857',uuid=82b619d5-e9e6-4e01-83f6-813de238bd5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:5d:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b2a7adb-93ed-409e-af90-6c594f623c07,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2a7adb-93') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG os_vif [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:5d:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b2a7adb-93ed-409e-af90-6c594f623c07,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2a7adb-93') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7bb4d3e-ba65-5aee-8c69-172d62a99902', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b2a7adb-93, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b2a7adb-93, col_values=(('qos', UUID('9790a61a-c18d-4a73-b1c6-c00780fdd86e')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b2a7adb-93, col_values=(('external_ids', {'iface-id': '2b2a7adb-93ed-409e-af90-6c594f623c07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:5d:6c', 'vm-uuid': '82b619d5-e9e6-4e01-83f6-813de238bd5a'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:02 user nova-compute[74658]: INFO os_vif [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:5d:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b2a7adb-93ed-409e-af90-6c594f623c07,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2a7adb-93')
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No VIF found with MAC fa:16:3e:a3:5d:6c, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.network.neutron [req-57a1dea0-993d-4f30-b4f3-7e0448c20a5f req-39172eb3-4bac-4036-adcd-345210e91b8d service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updated VIF entry in instance network info cache for port 2b2a7adb-93ed-409e-af90-6c594f623c07. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.network.neutron [req-57a1dea0-993d-4f30-b4f3-7e0448c20a5f req-39172eb3-4bac-4036-adcd-345210e91b8d service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updating instance_info_cache with network_info: [{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-57a1dea0-993d-4f30-b4f3-7e0448c20a5f req-39172eb3-4bac-4036-adcd-345210e91b8d service nova] Releasing lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Successfully updated port: ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquired lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-3f7d1434-6ebb-4a8f-aa55-a3d869fd577a req-c899c81e-c682-4cb6-94f3-fd3f87164c1a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received event network-changed-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-3f7d1434-6ebb-4a8f-aa55-a3d869fd577a req-c899c81e-c682-4cb6-94f3-fd3f87164c1a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Refreshing instance network info cache due to event network-changed-ff0bce81-b59f-40d5-a192-d0761ba5709b. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3f7d1434-6ebb-4a8f-aa55-a3d869fd577a req-c899c81e-c682-4cb6-94f3-fd3f87164c1a service nova] Acquiring lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:37:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updating instance_info_cache with network_info: [{"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Releasing lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Instance network_info: |[{"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3f7d1434-6ebb-4a8f-aa55-a3d869fd577a req-c899c81e-c682-4cb6-94f3-fd3f87164c1a service nova] Acquired lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-3f7d1434-6ebb-4a8f-aa55-a3d869fd577a req-c899c81e-c682-4cb6-94f3-fd3f87164c1a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Refreshing network info cache for port ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Start _get_guest_xml network_info=[{"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:37:03 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:37:03 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1366088746',display_name='tempest-ServerRescueNegativeTestJSON-server-1366088746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1366088746',id=40,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-s7spn2os',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:37:01Z,user_data=None,user_id='9a638862f3424fda9cd0a29b76596857',uuid=7ec5f4b8-e749-4121-9206-4e8ddf45981d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c3:f5,bridge_name='br-int',has_traffic_filtering=True,id=ff0bce81-b59f-40d5-a192-d0761ba5709b,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0bce81-b5') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ec5f4b8-e749-4121-9206-4e8ddf45981d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:37:03 user nova-compute[74658]:   <uuid>7ec5f4b8-e749-4121-9206-4e8ddf45981d</uuid>
Nov 16 15:37:03 user nova-compute[74658]:   <name>instance-00000028</name>
Nov 16 15:37:03 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:37:03 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:37:03 user nova-compute[74658]:   <metadata>
Nov 16 15:37:03 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:37:03 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:37:03 user nova-compute[74658]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1366088746</nova:name>
Nov 16 15:37:03 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:37:03</nova:creationTime>
Nov 16 15:37:03 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:37:03 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:37:03 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:37:03 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:37:03 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:37:03 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:37:03 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:37:03 user nova-compute[74658]:       <nova:owner>
Nov 16 15:37:03 user nova-compute[74658]:         <nova:user uuid="9a638862f3424fda9cd0a29b76596857">tempest-ServerRescueNegativeTestJSON-1957488214-project-member</nova:user>
Nov 16 15:37:03 user nova-compute[74658]:         <nova:project uuid="681f27eda6c74c20be18669837ace195">tempest-ServerRescueNegativeTestJSON-1957488214</nova:project>
Nov 16 15:37:03 user nova-compute[74658]:       </nova:owner>
Nov 16 15:37:03 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:37:03 user nova-compute[74658]:       <nova:ports>
Nov 16 15:37:03 user nova-compute[74658]:         <nova:port uuid="ff0bce81-b59f-40d5-a192-d0761ba5709b">
Nov 16 15:37:03 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 15:37:03 user nova-compute[74658]:         </nova:port>
Nov 16 15:37:03 user nova-compute[74658]:       </nova:ports>
Nov 16 15:37:03 user nova-compute[74658]:     </nova:instance>
Nov 16 15:37:03 user nova-compute[74658]:   </metadata>
Nov 16 15:37:03 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:37:03 user nova-compute[74658]:     <system>
Nov 16 15:37:03 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:37:03 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:37:03 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:37:03 user nova-compute[74658]:       <entry name="serial">7ec5f4b8-e749-4121-9206-4e8ddf45981d</entry>
Nov 16 15:37:03 user nova-compute[74658]:       <entry name="uuid">7ec5f4b8-e749-4121-9206-4e8ddf45981d</entry>
Nov 16 15:37:03 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:37:03 user nova-compute[74658]:     </system>
Nov 16 15:37:03 user nova-compute[74658]:   </sysinfo>
Nov 16 15:37:03 user nova-compute[74658]:   <os>
Nov 16 15:37:03 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:37:03 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:37:03 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:37:03 user nova-compute[74658]:   </os>
Nov 16 15:37:03 user nova-compute[74658]:   <features>
Nov 16 15:37:03 user nova-compute[74658]:     <acpi/>
Nov 16 15:37:03 user nova-compute[74658]:     <apic/>
Nov 16 15:37:03 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:37:03 user nova-compute[74658]:   </features>
Nov 16 15:37:03 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:37:03 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:37:03 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:37:03 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:37:03 user nova-compute[74658]:   </clock>
Nov 16 15:37:03 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:37:03 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:37:03 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:37:03 user nova-compute[74658]:   </cpu>
Nov 16 15:37:03 user nova-compute[74658]:   <devices>
Nov 16 15:37:03 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:37:03 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:37:03 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk"/>
Nov 16 15:37:03 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:37:03 user nova-compute[74658]:     </disk>
Nov 16 15:37:03 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:37:03 user nova-compute[74658]:       <mac address="fa:16:3e:eb:c3:f5"/>
Nov 16 15:37:03 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:37:03 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:37:03 user nova-compute[74658]:       <target dev="tapff0bce81-b5"/>
Nov 16 15:37:03 user nova-compute[74658]:     </interface>
Nov 16 15:37:03 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:37:03 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/console.log" append="off"/>
Nov 16 15:37:03 user nova-compute[74658]:     </serial>
Nov 16 15:37:03 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:37:03 user nova-compute[74658]:     <video>
Nov 16 15:37:03 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:37:03 user nova-compute[74658]:     </video>
Nov 16 15:37:03 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:37:03 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:37:03 user nova-compute[74658]:     </rng>
Nov 16 15:37:03 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:37:03 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:37:03 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:37:03 user nova-compute[74658]:     </memballoon>
Nov 16 15:37:03 user nova-compute[74658]:   </devices>
Nov 16 15:37:03 user nova-compute[74658]: </domain>
Nov 16 15:37:03 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1366088746',display_name='tempest-ServerRescueNegativeTestJSON-server-1366088746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1366088746',id=40,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-s7spn2os',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:37:01Z,user_data=None,user_id='9a638862f3424fda9cd0a29b76596857',uuid=7ec5f4b8-e749-4121-9206-4e8ddf45981d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c3:f5,bridge_name='br-int',has_traffic_filtering=True,id=ff0bce81-b59f-40d5-a192-d0761ba5709b,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0bce81-b5') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG os_vif [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c3:f5,bridge_name='br-int',has_traffic_filtering=True,id=ff0bce81-b59f-40d5-a192-d0761ba5709b,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0bce81-b5') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd70da973-935e-54a9-8f9c-497187ef5aa0', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff0bce81-b5, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff0bce81-b5, col_values=(('qos', UUID('8cb408dd-0424-4a9e-a2d8-8bebc5a65e13')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff0bce81-b5, col_values=(('external_ids', {'iface-id': 'ff0bce81-b59f-40d5-a192-d0761ba5709b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:c3:f5', 'vm-uuid': '7ec5f4b8-e749-4121-9206-4e8ddf45981d'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: INFO os_vif [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c3:f5,bridge_name='br-int',has_traffic_filtering=True,id=ff0bce81-b59f-40d5-a192-d0761ba5709b,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0bce81-b5')
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No VIF found with MAC fa:16:3e:eb:c3:f5, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-3f7d1434-6ebb-4a8f-aa55-a3d869fd577a req-c899c81e-c682-4cb6-94f3-fd3f87164c1a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updated VIF entry in instance network info cache for port ff0bce81-b59f-40d5-a192-d0761ba5709b. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-3f7d1434-6ebb-4a8f-aa55-a3d869fd577a req-c899c81e-c682-4cb6-94f3-fd3f87164c1a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updating instance_info_cache with network_info: [{"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3f7d1434-6ebb-4a8f-aa55-a3d869fd577a req-c899c81e-c682-4cb6-94f3-fd3f87164c1a service nova] Releasing lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-82ebb351-1b9f-43d2-9a66-2f5e7f0c036c req-04913f1a-cf4d-40a6-b031-92c0dadd07bd service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-82ebb351-1b9f-43d2-9a66-2f5e7f0c036c req-04913f1a-cf4d-40a6-b031-92c0dadd07bd service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-82ebb351-1b9f-43d2-9a66-2f5e7f0c036c req-04913f1a-cf4d-40a6-b031-92c0dadd07bd service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-82ebb351-1b9f-43d2-9a66-2f5e7f0c036c req-04913f1a-cf4d-40a6-b031-92c0dadd07bd service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-82ebb351-1b9f-43d2-9a66-2f5e7f0c036c req-04913f1a-cf4d-40a6-b031-92c0dadd07bd service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:37:03 user nova-compute[74658]: WARNING nova.compute.manager [req-82ebb351-1b9f-43d2-9a66-2f5e7f0c036c req-04913f1a-cf4d-40a6-b031-92c0dadd07bd service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state building and task_state spawning.
Nov 16 15:37:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-32407099-f42e-429c-8e81-9bc819d470c4 req-ad8e767d-2592-4620-a5b0-4e6659efa8f8 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-32407099-f42e-429c-8e81-9bc819d470c4 req-ad8e767d-2592-4620-a5b0-4e6659efa8f8 service nova] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-32407099-f42e-429c-8e81-9bc819d470c4 req-ad8e767d-2592-4620-a5b0-4e6659efa8f8 service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-32407099-f42e-429c-8e81-9bc819d470c4 req-ad8e767d-2592-4620-a5b0-4e6659efa8f8 service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-32407099-f42e-429c-8e81-9bc819d470c4 req-ad8e767d-2592-4620-a5b0-4e6659efa8f8 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] No waiting events found dispatching network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:37:05 user nova-compute[74658]: WARNING nova.compute.manager [req-32407099-f42e-429c-8e81-9bc819d470c4 req-ad8e767d-2592-4620-a5b0-4e6659efa8f8 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received unexpected event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b for instance with vm_state building and task_state spawning.
Nov 16 15:37:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-146bf6ec-cf56-4b6b-ab48-562c168745f1 req-b4648575-f984-4f07-b329-8f607ecd5e2b service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-146bf6ec-cf56-4b6b-ab48-562c168745f1 req-b4648575-f984-4f07-b329-8f607ecd5e2b service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-146bf6ec-cf56-4b6b-ab48-562c168745f1 req-b4648575-f984-4f07-b329-8f607ecd5e2b service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-146bf6ec-cf56-4b6b-ab48-562c168745f1 req-b4648575-f984-4f07-b329-8f607ecd5e2b service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-146bf6ec-cf56-4b6b-ab48-562c168745f1 req-b4648575-f984-4f07-b329-8f607ecd5e2b service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:37:05 user nova-compute[74658]: WARNING nova.compute.manager [req-146bf6ec-cf56-4b6b-ab48-562c168745f1 req-b4648575-f984-4f07-b329-8f607ecd5e2b service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state building and task_state spawning.
Nov 16 15:37:06 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:37:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:37:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:06 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Instance spawned successfully.
Nov 16 15:37:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:37:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:07 user nova-compute[74658]: INFO nova.compute.manager [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Took 7.08 seconds to spawn the instance on the hypervisor.
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:37:07 user nova-compute[74658]: INFO nova.compute.manager [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Took 7.79 seconds to build instance.
Nov 16 15:37:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b57b5d00-9134-4d29-84a8-88b4cfe02980 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.893s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:37:07 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Instance spawned successfully.
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:07 user nova-compute[74658]: INFO nova.compute.manager [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:37:07 user nova-compute[74658]: INFO nova.compute.manager [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Took 7.08 seconds to build instance.
Nov 16 15:37:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5324539c-02b1-4095-8a1e-fbeab1ec42c0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.232s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-859901ee-7a16-4ef1-a41e-74e67019f438 req-435ff878-bacb-4fae-91f7-51abc2237d2f service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-859901ee-7a16-4ef1-a41e-74e67019f438 req-435ff878-bacb-4fae-91f7-51abc2237d2f service nova] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-859901ee-7a16-4ef1-a41e-74e67019f438 req-435ff878-bacb-4fae-91f7-51abc2237d2f service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-859901ee-7a16-4ef1-a41e-74e67019f438 req-435ff878-bacb-4fae-91f7-51abc2237d2f service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-859901ee-7a16-4ef1-a41e-74e67019f438 req-435ff878-bacb-4fae-91f7-51abc2237d2f service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] No waiting events found dispatching network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:37:07 user nova-compute[74658]: WARNING nova.compute.manager [req-859901ee-7a16-4ef1-a41e-74e67019f438 req-435ff878-bacb-4fae-91f7-51abc2237d2f service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received unexpected event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b for instance with vm_state active and task_state None.
Nov 16 15:37:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:37:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:37:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:37:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:37:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:37:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:37:09 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid bbbdb32b-2c3f-4c2f-9395-9c983242e124 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Updating instance_info_cache with network_info: [{"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "68cbf793-b573-44fd-97e2-e43f22c86b45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:10 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:37:10 user nova-compute[74658]: INFO nova.compute.claims [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Claim successful on node user
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:37:11 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.policy [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c9d25b034454cb08cd29e785af6bed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be0dc9ded2d4a638a2f17c7c2a6c1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:37:11 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Creating image(s)
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "/opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "/opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "/opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.237s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.190s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk 1073741824" returned: 0 in 0.089s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Successfully created port: 9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.201s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Cannot resize image /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Ensure instance console log exists: /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Successfully updated port: 9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "refresh_cache-68cbf793-b573-44fd-97e2-e43f22c86b45" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquired lock "refresh_cache-68cbf793-b573-44fd-97e2-e43f22c86b45" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-7c780028-326c-4cea-8f84-da1eefa7bcf7 req-81e5e803-a95c-4544-9bdd-11e71db59da7 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Received event network-changed-9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-7c780028-326c-4cea-8f84-da1eefa7bcf7 req-81e5e803-a95c-4544-9bdd-11e71db59da7 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Refreshing instance network info cache due to event network-changed-9461bfd8-5aea-45ee-9241-b95b771cf460. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c780028-326c-4cea-8f84-da1eefa7bcf7 req-81e5e803-a95c-4544-9bdd-11e71db59da7 service nova] Acquiring lock "refresh_cache-68cbf793-b573-44fd-97e2-e43f22c86b45" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:37:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:13 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:37:13 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8453MB free_disk=25.39447784423828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ad92b41d-2fe6-4e3d-877e-aebf361ddb14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 459a4296-6338-49d3-a3ba-f881418f9d7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 68cbf793-b573-44fd-97e2-e43f22c86b45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Updating instance_info_cache with network_info: [{"id": "9461bfd8-5aea-45ee-9241-b95b771cf460", "address": "fa:16:3e:05:74:46", "network": {"id": "b97deb7d-4ac9-46a0-b8bb-c65ef92e892b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-692810974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2be0dc9ded2d4a638a2f17c7c2a6c1c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9461bfd8-5a", "ovs_interfaceid": "9461bfd8-5aea-45ee-9241-b95b771cf460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Releasing lock "refresh_cache-68cbf793-b573-44fd-97e2-e43f22c86b45" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Instance network_info: |[{"id": "9461bfd8-5aea-45ee-9241-b95b771cf460", "address": "fa:16:3e:05:74:46", "network": {"id": "b97deb7d-4ac9-46a0-b8bb-c65ef92e892b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-692810974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2be0dc9ded2d4a638a2f17c7c2a6c1c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9461bfd8-5a", "ovs_interfaceid": "9461bfd8-5aea-45ee-9241-b95b771cf460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c780028-326c-4cea-8f84-da1eefa7bcf7 req-81e5e803-a95c-4544-9bdd-11e71db59da7 service nova] Acquired lock "refresh_cache-68cbf793-b573-44fd-97e2-e43f22c86b45" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-7c780028-326c-4cea-8f84-da1eefa7bcf7 req-81e5e803-a95c-4544-9bdd-11e71db59da7 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Refreshing network info cache for port 9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Start _get_guest_xml network_info=[{"id": "9461bfd8-5aea-45ee-9241-b95b771cf460", "address": "fa:16:3e:05:74:46", "network": {"id": "b97deb7d-4ac9-46a0-b8bb-c65ef92e892b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-692810974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2be0dc9ded2d4a638a2f17c7c2a6c1c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9461bfd8-5a", "ovs_interfaceid": "9461bfd8-5aea-45ee-9241-b95b771cf460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:37:13 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:37:13 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:37:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125171517',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125171517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2125171',id=41,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxreju2YX3deN4Zm8dK99o/9eHIP5tQwIbSBmoURStHh7sTSWn4yshGnaOqSz5XfO5rbwqf6/MzASUX4woAZZHW21BQg12aCd0Ai5IHpKXBub+Ne3RmhVR6M1m+t5iQag==',key_name='tempest-keypair-706080034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2be0dc9ded2d4a638a2f17c7c2a6c1c2',ramdisk_id='',reservation_id='r-46o19zc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2092989913',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c9d25b034454cb08cd29e785af6bed6',uuid=68cbf793-b573-44fd-97e2-e43f22c86b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9461bfd8-5aea-45ee-9241-b95b771cf460", "address": "fa:16:3e:05:74:46", "network": {"id": "b97deb7d-4ac9-46a0-b8bb-c65ef92e892b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-692810974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2be0dc9ded2d4a638a2f17c7c2a6c1c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9461bfd8-5a", "ovs_interfaceid": "9461bfd8-5aea-45ee-9241-b95b771cf460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Converting VIF {"id": "9461bfd8-5aea-45ee-9241-b95b771cf460", "address": "fa:16:3e:05:74:46", "network": {"id": "b97deb7d-4ac9-46a0-b8bb-c65ef92e892b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-692810974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2be0dc9ded2d4a638a2f17c7c2a6c1c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9461bfd8-5a", "ovs_interfaceid": "9461bfd8-5aea-45ee-9241-b95b771cf460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:74:46,bridge_name='br-int',has_traffic_filtering=True,id=9461bfd8-5aea-45ee-9241-b95b771cf460,network=Network(b97deb7d-4ac9-46a0-b8bb-c65ef92e892b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9461bfd8-5a') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.objects.instance [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lazy-loading 'pci_devices' on Instance uuid 68cbf793-b573-44fd-97e2-e43f22c86b45 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:37:13 user nova-compute[74658]:   <uuid>68cbf793-b573-44fd-97e2-e43f22c86b45</uuid>
Nov 16 15:37:13 user nova-compute[74658]:   <name>instance-00000029</name>
Nov 16 15:37:13 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:37:13 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:37:13 user nova-compute[74658]:   <metadata>
Nov 16 15:37:13 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:37:13 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:37:13 user nova-compute[74658]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2125171517</nova:name>
Nov 16 15:37:13 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:37:13</nova:creationTime>
Nov 16 15:37:13 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:37:13 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:37:13 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:37:13 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:37:13 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:37:13 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:37:13 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:37:13 user nova-compute[74658]:       <nova:owner>
Nov 16 15:37:13 user nova-compute[74658]:         <nova:user uuid="2c9d25b034454cb08cd29e785af6bed6">tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member</nova:user>
Nov 16 15:37:13 user nova-compute[74658]:         <nova:project uuid="2be0dc9ded2d4a638a2f17c7c2a6c1c2">tempest-TestServerVolumeAttachScenarioOldVersion-2092989913</nova:project>
Nov 16 15:37:13 user nova-compute[74658]:       </nova:owner>
Nov 16 15:37:13 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:37:13 user nova-compute[74658]:       <nova:ports>
Nov 16 15:37:13 user nova-compute[74658]:         <nova:port uuid="9461bfd8-5aea-45ee-9241-b95b771cf460">
Nov 16 15:37:13 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 15:37:13 user nova-compute[74658]:         </nova:port>
Nov 16 15:37:13 user nova-compute[74658]:       </nova:ports>
Nov 16 15:37:13 user nova-compute[74658]:     </nova:instance>
Nov 16 15:37:13 user nova-compute[74658]:   </metadata>
Nov 16 15:37:13 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:37:13 user nova-compute[74658]:     <system>
Nov 16 15:37:13 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:37:13 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:37:13 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:37:13 user nova-compute[74658]:       <entry name="serial">68cbf793-b573-44fd-97e2-e43f22c86b45</entry>
Nov 16 15:37:13 user nova-compute[74658]:       <entry name="uuid">68cbf793-b573-44fd-97e2-e43f22c86b45</entry>
Nov 16 15:37:13 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:37:13 user nova-compute[74658]:     </system>
Nov 16 15:37:13 user nova-compute[74658]:   </sysinfo>
Nov 16 15:37:13 user nova-compute[74658]:   <os>
Nov 16 15:37:13 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:37:13 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:37:13 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:37:13 user nova-compute[74658]:   </os>
Nov 16 15:37:13 user nova-compute[74658]:   <features>
Nov 16 15:37:13 user nova-compute[74658]:     <acpi/>
Nov 16 15:37:13 user nova-compute[74658]:     <apic/>
Nov 16 15:37:13 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:37:13 user nova-compute[74658]:   </features>
Nov 16 15:37:13 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:37:13 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:37:13 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:37:13 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:37:13 user nova-compute[74658]:   </clock>
Nov 16 15:37:13 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:37:13 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:37:13 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:37:13 user nova-compute[74658]:   </cpu>
Nov 16 15:37:13 user nova-compute[74658]:   <devices>
Nov 16 15:37:13 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:37:13 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:37:13 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk"/>
Nov 16 15:37:13 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:37:13 user nova-compute[74658]:     </disk>
Nov 16 15:37:13 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:37:13 user nova-compute[74658]:       <mac address="fa:16:3e:05:74:46"/>
Nov 16 15:37:13 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:37:13 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:37:13 user nova-compute[74658]:       <target dev="tap9461bfd8-5a"/>
Nov 16 15:37:13 user nova-compute[74658]:     </interface>
Nov 16 15:37:13 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:37:13 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/console.log" append="off"/>
Nov 16 15:37:13 user nova-compute[74658]:     </serial>
Nov 16 15:37:13 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:37:13 user nova-compute[74658]:     <video>
Nov 16 15:37:13 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:37:13 user nova-compute[74658]:     </video>
Nov 16 15:37:13 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:37:13 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:37:13 user nova-compute[74658]:     </rng>
Nov 16 15:37:13 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:37:13 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:37:13 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:37:13 user nova-compute[74658]:     </memballoon>
Nov 16 15:37:13 user nova-compute[74658]:   </devices>
Nov 16 15:37:13 user nova-compute[74658]: </domain>
Nov 16 15:37:13 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:37:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125171517',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125171517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2125171',id=41,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxreju2YX3deN4Zm8dK99o/9eHIP5tQwIbSBmoURStHh7sTSWn4yshGnaOqSz5XfO5rbwqf6/MzASUX4woAZZHW21BQg12aCd0Ai5IHpKXBub+Ne3RmhVR6M1m+t5iQag==',key_name='tempest-keypair-706080034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2be0dc9ded2d4a638a2f17c7c2a6c1c2',ramdisk_id='',reservation_id='r-46o19zc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2092989913',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c9d25b034454cb08cd29e785af6bed6',uuid=68cbf793-b573-44fd-97e2-e43f22c86b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9461bfd8-5aea-45ee-9241-b95b771cf460", "address": "fa:16:3e:05:74:46", "network": {"id": "b97deb7d-4ac9-46a0-b8bb-c65ef92e892b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-692810974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2be0dc9ded2d4a638a2f17c7c2a6c1c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9461bfd8-5a", "ovs_interfaceid": "9461bfd8-5aea-45ee-9241-b95b771cf460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Converting VIF {"id": "9461bfd8-5aea-45ee-9241-b95b771cf460", "address": "fa:16:3e:05:74:46", "network": {"id": "b97deb7d-4ac9-46a0-b8bb-c65ef92e892b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-692810974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2be0dc9ded2d4a638a2f17c7c2a6c1c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9461bfd8-5a", "ovs_interfaceid": "9461bfd8-5aea-45ee-9241-b95b771cf460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:74:46,bridge_name='br-int',has_traffic_filtering=True,id=9461bfd8-5aea-45ee-9241-b95b771cf460,network=Network(b97deb7d-4ac9-46a0-b8bb-c65ef92e892b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9461bfd8-5a') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG os_vif [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:74:46,bridge_name='br-int',has_traffic_filtering=True,id=9461bfd8-5aea-45ee-9241-b95b771cf460,network=Network(b97deb7d-4ac9-46a0-b8bb-c65ef92e892b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9461bfd8-5a') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bdd9374-918a-5021-88fa-917ed0e954ab', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9461bfd8-5a, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9461bfd8-5a, col_values=(('qos', UUID('86e35295-0eec-417f-9cb6-9241ce73f1aa')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9461bfd8-5a, col_values=(('external_ids', {'iface-id': '9461bfd8-5aea-45ee-9241-b95b771cf460', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:74:46', 'vm-uuid': '68cbf793-b573-44fd-97e2-e43f22c86b45'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:13 user nova-compute[74658]: INFO os_vif [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:74:46,bridge_name='br-int',has_traffic_filtering=True,id=9461bfd8-5aea-45ee-9241-b95b771cf460,network=Network(b97deb7d-4ac9-46a0-b8bb-c65ef92e892b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9461bfd8-5a')
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] No VIF found with MAC fa:16:3e:05:74:46, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-7c780028-326c-4cea-8f84-da1eefa7bcf7 req-81e5e803-a95c-4544-9bdd-11e71db59da7 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Updated VIF entry in instance network info cache for port 9461bfd8-5aea-45ee-9241-b95b771cf460. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-7c780028-326c-4cea-8f84-da1eefa7bcf7 req-81e5e803-a95c-4544-9bdd-11e71db59da7 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Updating instance_info_cache with network_info: [{"id": "9461bfd8-5aea-45ee-9241-b95b771cf460", "address": "fa:16:3e:05:74:46", "network": {"id": "b97deb7d-4ac9-46a0-b8bb-c65ef92e892b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-692810974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2be0dc9ded2d4a638a2f17c7c2a6c1c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9461bfd8-5a", "ovs_interfaceid": "9461bfd8-5aea-45ee-9241-b95b771cf460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:37:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c780028-326c-4cea-8f84-da1eefa7bcf7 req-81e5e803-a95c-4544-9bdd-11e71db59da7 service nova] Releasing lock "refresh_cache-68cbf793-b573-44fd-97e2-e43f22c86b45" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:37:14 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:37:14 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:37:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-165207d3-3652-4941-9458-59f2c50abb49 req-78617d7a-53b7-4d23-9c82-0cc4bc63359a service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Received event network-vif-plugged-9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-165207d3-3652-4941-9458-59f2c50abb49 req-78617d7a-53b7-4d23-9c82-0cc4bc63359a service nova] Acquiring lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-165207d3-3652-4941-9458-59f2c50abb49 req-78617d7a-53b7-4d23-9c82-0cc4bc63359a service nova] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-165207d3-3652-4941-9458-59f2c50abb49 req-78617d7a-53b7-4d23-9c82-0cc4bc63359a service nova] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-165207d3-3652-4941-9458-59f2c50abb49 req-78617d7a-53b7-4d23-9c82-0cc4bc63359a service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] No waiting events found dispatching network-vif-plugged-9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:37:15 user nova-compute[74658]: WARNING nova.compute.manager [req-165207d3-3652-4941-9458-59f2c50abb49 req-78617d7a-53b7-4d23-9c82-0cc4bc63359a service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Received unexpected event network-vif-plugged-9461bfd8-5aea-45ee-9241-b95b771cf460 for instance with vm_state building and task_state spawning.
Nov 16 15:37:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:37:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Instance spawned successfully.
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-16cde5d7-d6df-45c3-9ab0-4b9030b92ab0 req-f85f7e16-88df-4bb7-957a-6f228b269bbc service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Received event network-vif-plugged-9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-16cde5d7-d6df-45c3-9ab0-4b9030b92ab0 req-f85f7e16-88df-4bb7-957a-6f228b269bbc service nova] Acquiring lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-16cde5d7-d6df-45c3-9ab0-4b9030b92ab0 req-f85f7e16-88df-4bb7-957a-6f228b269bbc service nova] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-16cde5d7-d6df-45c3-9ab0-4b9030b92ab0 req-f85f7e16-88df-4bb7-957a-6f228b269bbc service nova] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-16cde5d7-d6df-45c3-9ab0-4b9030b92ab0 req-f85f7e16-88df-4bb7-957a-6f228b269bbc service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] No waiting events found dispatching network-vif-plugged-9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:37:17 user nova-compute[74658]: WARNING nova.compute.manager [req-16cde5d7-d6df-45c3-9ab0-4b9030b92ab0 req-f85f7e16-88df-4bb7-957a-6f228b269bbc service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Received unexpected event network-vif-plugged-9461bfd8-5aea-45ee-9241-b95b771cf460 for instance with vm_state building and task_state spawning.
Nov 16 15:37:17 user nova-compute[74658]: INFO nova.compute.manager [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 16 15:37:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:37:17 user nova-compute[74658]: INFO nova.compute.manager [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Took 6.76 seconds to build instance.
Nov 16 15:37:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be4f4d47-5f57-44e2-b49d-3e957b8a0542 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.864s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:21 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:37:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-78993a4a-7f90-44a8-93b8-b21d65632f96 req-09ac8dc3-dc09-4933-9837-d1a1a237038d service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Received event network-changed-f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-78993a4a-7f90-44a8-93b8-b21d65632f96 req-09ac8dc3-dc09-4933-9837-d1a1a237038d service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Refreshing instance network info cache due to event network-changed-f85390fc-0174-409a-93c1-88f17f39eb94. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:37:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78993a4a-7f90-44a8-93b8-b21d65632f96 req-09ac8dc3-dc09-4933-9837-d1a1a237038d service nova] Acquiring lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:37:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78993a4a-7f90-44a8-93b8-b21d65632f96 req-09ac8dc3-dc09-4933-9837-d1a1a237038d service nova] Acquired lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:37:37 user nova-compute[74658]: DEBUG nova.network.neutron [req-78993a4a-7f90-44a8-93b8-b21d65632f96 req-09ac8dc3-dc09-4933-9837-d1a1a237038d service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Refreshing network info cache for port f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:37:37 user nova-compute[74658]: DEBUG nova.network.neutron [req-78993a4a-7f90-44a8-93b8-b21d65632f96 req-09ac8dc3-dc09-4933-9837-d1a1a237038d service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Updated VIF entry in instance network info cache for port f85390fc-0174-409a-93c1-88f17f39eb94. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:37:37 user nova-compute[74658]: DEBUG nova.network.neutron [req-78993a4a-7f90-44a8-93b8-b21d65632f96 req-09ac8dc3-dc09-4933-9837-d1a1a237038d service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Updating instance_info_cache with network_info: [{"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:37:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78993a4a-7f90-44a8-93b8-b21d65632f96 req-09ac8dc3-dc09-4933-9837-d1a1a237038d service nova] Releasing lock "refresh_cache-bbbdb32b-2c3f-4c2f-9395-9c983242e124" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:37:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG nova.objects.instance [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid bbbdb32b-2c3f-4c2f-9395-9c983242e124 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:39 user nova-compute[74658]: INFO nova.compute.manager [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Attaching volume a65e60fe-cd8b-421b-a015-3dd1192e357e to /dev/vdb
Nov 16 15:37:39 user nova-compute[74658]: DEBUG os_brick.utils [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e1728d-2c4f-4b54-ad0c-aeefc9f4b7aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa4806d-228d-4559-9fc1-8b81bb3988c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8545c535-d750-440e-9c9b-34804f1be1dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aad0d9-6a09-42be-8662-b49f42f52db2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:37:39 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:37:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95eb97b-534d-4a02-b69c-62fdc12294d6]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG os_brick.utils [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:37:39 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Updating existing volume attachment record: cf6f2efb-dc3a-4bfc-a978-6ed85bd0be8a {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:37:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-d4642b05-bd16-4b51-b042-224b3cfb4803 req-59eaf84e-1911-4e13-bcec-090cd931fd41 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-changed-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-d4642b05-bd16-4b51-b042-224b3cfb4803 req-59eaf84e-1911-4e13-bcec-090cd931fd41 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Refreshing instance network info cache due to event network-changed-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d4642b05-bd16-4b51-b042-224b3cfb4803 req-59eaf84e-1911-4e13-bcec-090cd931fd41 service nova] Acquiring lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d4642b05-bd16-4b51-b042-224b3cfb4803 req-59eaf84e-1911-4e13-bcec-090cd931fd41 service nova] Acquired lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG nova.network.neutron [req-d4642b05-bd16-4b51-b042-224b3cfb4803 req-59eaf84e-1911-4e13-bcec-090cd931fd41 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Refreshing network info cache for port ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZOBpPLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:37:44 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:37:44 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:37:44 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5a6ab7-bd76-4598-ad70-2782937d3242]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:37:44 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8785db-9679-4c80-b61c-92768daa43dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e] added
Nov 16 15:37:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e1d161-166c-43a2-85ec-b97c358be151]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0464a1d8-8fb6-497f-bcbd-c4af467a7220]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MZOBpPLC {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MZOBpPLC" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b47fd8-e066-4438-8479-9e508a9fb58b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MZOBpPLC'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d84b7e-f7cf-4966-b8aa-2c1be18d339a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9f83d5-975d-40d6-8c58-9ad3f3e262c4]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:37:44 user nova-compute[74658]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:37:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:37:44 user nova-compute[74658]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:37:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a718f30f-95eb-4add-861c-c917605779e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e, portal: 172.16.0.220,3260]
Nov 16 15:37:44 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e, portal: 172.16.0.220,3260] successful.
Nov 16 15:37:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG nova.network.neutron [req-d4642b05-bd16-4b51-b042-224b3cfb4803 req-59eaf84e-1911-4e13-bcec-090cd931fd41 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updated VIF entry in instance network info cache for port ea57a3ae-37e3-4d66-8bf3-177f9303bf4f. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG nova.network.neutron [req-d4642b05-bd16-4b51-b042-224b3cfb4803 req-59eaf84e-1911-4e13-bcec-090cd931fd41 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating instance_info_cache with network_info: [{"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed5c641-fa81-4d46-9437-b6e9ba5446c5]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d4642b05-bd16-4b51-b042-224b3cfb4803 req-59eaf84e-1911-4e13-bcec-090cd931fd41 service nova] Releasing lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e03e22-ee38-4e14-90f3-3f99bba85678]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:37:44 user nova-compute[74658]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:37:44 user nova-compute[74658]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)
Nov 16 15:37:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:37:44 user nova-compute[74658]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:37:44 user nova-compute[74658]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)
Nov 16 15:37:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beb8bb7-1c81-40b0-b701-dc14a51493c5]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:37:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZOBpPLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:45 user nova-compute[74658]: INFO nova.compute.manager [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Shelve offloading
Nov 16 15:37:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-073e8160-bd4b-4905-b530-fad6ca7adf77 req-ae062116-ba54-47e6-a548-faa8428ab467 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-vif-unplugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-073e8160-bd4b-4905-b530-fad6ca7adf77 req-ae062116-ba54-47e6-a548-faa8428ab467 service nova] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-073e8160-bd4b-4905-b530-fad6ca7adf77 req-ae062116-ba54-47e6-a548-faa8428ab467 service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-073e8160-bd4b-4905-b530-fad6ca7adf77 req-ae062116-ba54-47e6-a548-faa8428ab467 service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-073e8160-bd4b-4905-b530-fad6ca7adf77 req-ae062116-ba54-47e6-a548-faa8428ab467 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] No waiting events found dispatching network-vif-unplugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:37:45 user nova-compute[74658]: WARNING nova.compute.manager [req-073e8160-bd4b-4905-b530-fad6ca7adf77 req-ae062116-ba54-47e6-a548-faa8428ab467 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received unexpected event network-vif-unplugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f for instance with vm_state active and task_state shelving.
Nov 16 15:37:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:45 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Instance destroyed successfully.
Nov 16 15:37:45 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquired lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23231616565633934', 'path': '/dev/sdd'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231616565633934', 'path': '/dev/sdd'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid bbbdb32b-2c3f-4c2f-9395-9c983242e124 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:37:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:37:45 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:37:45 user nova-compute[74658]:   <source dev="/dev/sdd"/>
Nov 16 15:37:45 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:37:45 user nova-compute[74658]:   <serial>a65e60fe-cd8b-421b-a015-3dd1192e357e</serial>
Nov 16 15:37:45 user nova-compute[74658]: </disk>
Nov 16 15:37:45 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.network.neutron [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating instance_info_cache with network_info: [{"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Releasing lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No VIF found with MAC fa:16:3e:10:18:c0, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-80e5b1af-580a-42db-ac1c-172b8631d59b tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.253s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:46 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Instance destroyed successfully.
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lazy-loading 'resources' on Instance uuid ad92b41d-2fe6-4e3d-877e-aebf361ddb14 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1301805927',display_name='tempest-TestShelveInstance-server-1301805927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1301805927',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPygr6WU5+gJuACnR5fZxHlm6rFQhOM6IijIWomXPqOXhz63SuWkK3DOw++IKsdq0+FUAHKg11qCi6SrKszbVnBM+8+obzPMY1A4VqSJZrmbboLiW+D8HJUau+NJ7KBcfA==',key_name='tempest-TestShelveInstance-1228229818',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:36:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61ceda4e12ea4af5bdcb9f93cae4f24c',ramdisk_id='',reservation_id='r-gsvqsadq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-182953903',owner_user_name='tempest-TestShelveInstance-182953903-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:36:03Z,user_data=None,user_id='1f6f0cd0dea04b80a446774baf70b89e',uuid=ad92b41d-2fe6-4e3d-877e-aebf361ddb14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converting VIF {"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_vif [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea57a3ae-37, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27aafac5-fe5c-4411-ae76-d9daa3c5958f) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc9345f5-bd28-4756-b54a-b68b236a86a2 req-59a4dc56-38ec-44db-a8bd-75c5bf209e38 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-changed-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc9345f5-bd28-4756-b54a-b68b236a86a2 req-59a4dc56-38ec-44db-a8bd-75c5bf209e38 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Refreshing instance network info cache due to event network-changed-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc9345f5-bd28-4756-b54a-b68b236a86a2 req-59a4dc56-38ec-44db-a8bd-75c5bf209e38 service nova] Acquiring lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc9345f5-bd28-4756-b54a-b68b236a86a2 req-59a4dc56-38ec-44db-a8bd-75c5bf209e38 service nova] Acquired lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.network.neutron [req-fc9345f5-bd28-4756-b54a-b68b236a86a2 req-59a4dc56-38ec-44db-a8bd-75c5bf209e38 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Refreshing network info cache for port ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:37:46 user nova-compute[74658]: INFO os_vif [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37')
Nov 16 15:37:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZujWacb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:37:46 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d8da66-900a-4b71-a94f-2fa4039743a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:37:46 user nova-compute[74658]: No targets found.
Nov 16 15:37:46 user nova-compute[74658]: iSNS:
Nov 16 15:37:46 user nova-compute[74658]: No targets found.
Nov 16 15:37:46 user nova-compute[74658]: STATIC:
Nov 16 15:37:46 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e
Nov 16 15:37:46 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:37:46 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:37:46 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014
Nov 16 15:37:46 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:37:46 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:37:46 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6
Nov 16 15:37:46 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:37:46 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:37:46 user nova-compute[74658]: FIRMWARE:
Nov 16 15:37:46 user nova-compute[74658]: No targets found.
Nov 16 15:37:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:37:46 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:37:46 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[302825b5-e4c3-4d82-8eff-e04f9d254272]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d1f41c-0c40-4390-b33f-54f772b7feca]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:37:46 user nova-compute[74658]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:37:46 user nova-compute[74658]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)
Nov 16 15:37:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:37:46 user nova-compute[74658]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:37:46 user nova-compute[74658]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)
Nov 16 15:37:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f071034f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[185c4df9-a5a2-43da-87f7-80a608e402bc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a128c83-a5fb-4c10-8d86-cf22cefc5a6c]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fcee67-c91a-4507-b3e0-4e4ed30c5e73]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[03db3b9e-4161-4763-a3bf-89332db29dde]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6898b3-f75a-47df-8b76-9827d4bf2cd6]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[af34a0ef-d23c-48b7-88ea-27579db6c9d6]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260]
Nov 16 15:37:47 user nova-compute[74658]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260] successful.
Nov 16 15:37:47 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0affd10-b472-48b5-a155-daefb9dafac2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] <== disconnect_volume: return (310ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:37:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Deleting instance files /opt/stack/data/nova/instances/ad92b41d-2fe6-4e3d-877e-aebf361ddb14_del
Nov 16 15:37:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Deletion of /opt/stack/data/nova/instances/ad92b41d-2fe6-4e3d-877e-aebf361ddb14_del complete
Nov 16 15:37:47 user nova-compute[74658]: DEBUG nova.network.neutron [req-fc9345f5-bd28-4756-b54a-b68b236a86a2 req-59a4dc56-38ec-44db-a8bd-75c5bf209e38 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updated VIF entry in instance network info cache for port ea57a3ae-37e3-4d66-8bf3-177f9303bf4f. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG nova.network.neutron [req-fc9345f5-bd28-4756-b54a-b68b236a86a2 req-59a4dc56-38ec-44db-a8bd-75c5bf209e38 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating instance_info_cache with network_info: [{"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": null, "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapea57a3ae-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc9345f5-bd28-4756-b54a-b68b236a86a2 req-59a4dc56-38ec-44db-a8bd-75c5bf209e38 service nova] Releasing lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-9d6b0a89-4aae-4586-846e-2ce4b6fa357d req-49fbc8af-cca4-4078-8d51-7f16fedd0105 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9d6b0a89-4aae-4586-846e-2ce4b6fa357d req-49fbc8af-cca4-4078-8d51-7f16fedd0105 service nova] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9d6b0a89-4aae-4586-846e-2ce4b6fa357d req-49fbc8af-cca4-4078-8d51-7f16fedd0105 service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9d6b0a89-4aae-4586-846e-2ce4b6fa357d req-49fbc8af-cca4-4078-8d51-7f16fedd0105 service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-9d6b0a89-4aae-4586-846e-2ce4b6fa357d req-49fbc8af-cca4-4078-8d51-7f16fedd0105 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] No waiting events found dispatching network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:37:47 user nova-compute[74658]: WARNING nova.compute.manager [req-9d6b0a89-4aae-4586-846e-2ce4b6fa357d req-49fbc8af-cca4-4078-8d51-7f16fedd0105 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received unexpected event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f for instance with vm_state active and task_state shelving.
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG nova.objects.instance [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid bbbdb32b-2c3f-4c2f-9395-9c983242e124 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:48 user nova-compute[74658]: INFO nova.compute.manager [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Attaching volume 4a72fac8-1a84-44c7-8d5c-7df85a96b00c to /dev/vdc
Nov 16 15:37:48 user nova-compute[74658]: DEBUG os_brick.utils [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd72a6a-3d32-491f-a5f0-dda1d91ec197]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[799b4c40-4610-4edc-8a3b-4f94580e1f0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce6294e-3074-4cc6-8c96-bc0a2e4d1a98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ea4d34-c48d-42c4-8b83-31ba91bfe9b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:37:48 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:37:48 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc49174-626f-4a00-ad36-0eb1963f909e]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG os_brick.utils [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:37:48 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Updating existing volume attachment record: 39ce39f6-ce80-444c-8942-3501941cac9c {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:37:48 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Deleted allocations for instance ad92b41d-2fe6-4e3d-877e-aebf361ddb14
Nov 16 15:37:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:49 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lazy-loading 'numa_topology' on Instance uuid ad92b41d-2fe6-4e3d-877e-aebf361ddb14 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:37:49 user nova-compute[74658]: DEBUG nova.objects.base [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Object Instance<ad92b41d-2fe6-4e3d-877e-aebf361ddb14> lazy-loaded attributes: resources,numa_topology {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:37:49 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:37:49 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:37:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b2fcc172-ca49-4b8b-aa52-b960443dd4d3 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.322s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIQSxoOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:37:53 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:37:53 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:37:53 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac7fd37-d8cb-4093-8060-31a561d91da8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:37:53 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d5c63d-85b0-4d6e-a3d7-a3e422ddb855]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c] added
Nov 16 15:37:53 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[007ffeea-f5c5-4df9-b020-90dd45ba8f87]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e15d58-f3bb-4ede-ac5d-51b6a9ece075]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIQSxoOp {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIQSxoOp" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd977ad2-e386-4b74-90e0-22446abaa0d8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CIQSxoOp'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0e0849-983e-4085-99e9-3872922ef489]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf30b0e-e50e-430f-a949-5dfbc50b4556]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:37:53 user nova-compute[74658]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)
Nov 16 15:37:53 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:37:53 user nova-compute[74658]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)
Nov 16 15:37:53 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:37:53 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21fbfb4-cf28-4c59-9508-28acd78679d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c, portal: 172.16.0.220,3260]
Nov 16 15:37:54 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c, portal: 172.16.0.220,3260] successful.
Nov 16 15:37:54 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c61ae4e-c81b-43d0-868f-40639cc2843d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[537d3757-98c9-40d1-9f66-609e1f05c1dd]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:37:54 user nova-compute[74658]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)
Nov 16 15:37:54 user nova-compute[74658]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)
Nov 16 15:37:54 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:37:54 user nova-compute[74658]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)
Nov 16 15:37:54 user nova-compute[74658]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)
Nov 16 15:37:54 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3acf17-edd0-424c-b731-2f050e73ad86]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:37:54 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIQSxoOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23161356632343063', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161356632343063', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG nova.objects.instance [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid bbbdb32b-2c3f-4c2f-9395-9c983242e124 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:37:55 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:37:55 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:37:55 user nova-compute[74658]:   <target dev="vdc" bus="virtio"/>
Nov 16 15:37:55 user nova-compute[74658]:   <serial>4a72fac8-1a84-44c7-8d5c-7df85a96b00c</serial>
Nov 16 15:37:55 user nova-compute[74658]: </disk>
Nov 16 15:37:55 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] No VIF found with MAC fa:16:3e:10:18:c0, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d2d3c3e-f761-4302-bb0a-27045c647acb tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.041s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:37:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:37:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:37:56 user nova-compute[74658]: INFO nova.compute.manager [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Detaching volume a65e60fe-cd8b-421b-a015-3dd1192e357e
Nov 16 15:37:56 user nova-compute[74658]: INFO nova.virt.block_device [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Attempting to driver detach volume a65e60fe-cd8b-421b-a015-3dd1192e357e from mountpoint /dev/vdb
Nov 16 15:37:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Attempting to detach device vdb from instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:37:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:37:56 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:37:56 user nova-compute[74658]:   <source dev="/dev/sdd"/>
Nov 16 15:37:56 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:37:56 user nova-compute[74658]:   <serial>a65e60fe-cd8b-421b-a015-3dd1192e357e</serial>
Nov 16 15:37:56 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:37:56 user nova-compute[74658]: </disk>
Nov 16 15:37:56 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:37:56 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully detached device vdb from instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 from the persistent domain config.
Nov 16 15:37:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:37:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:37:56 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:37:56 user nova-compute[74658]:   <source dev="/dev/sdd"/>
Nov 16 15:37:56 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:37:56 user nova-compute[74658]:   <serial>a65e60fe-cd8b-421b-a015-3dd1192e357e</serial>
Nov 16 15:37:56 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:37:56 user nova-compute[74658]: </disk>
Nov 16 15:37:56 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:37:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:37:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:38:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:01 user nova-compute[74658]: INFO nova.compute.manager [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Unshelving
Nov 16 15:38:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:01 user nova-compute[74658]: DEBUG nova.objects.instance [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'pci_requests' on Instance uuid 396c5838-c4aa-4b02-9b9a-4f3296d85f2f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:01 user nova-compute[74658]: DEBUG nova.objects.instance [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'numa_topology' on Instance uuid 396c5838-c4aa-4b02-9b9a-4f3296d85f2f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:01 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:38:01 user nova-compute[74658]: INFO nova.compute.claims [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Claim successful on node user
Nov 16 15:38:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:01 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:38:01 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:38:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:02 user nova-compute[74658]: INFO nova.network.neutron [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updating port 5c27e2c4-4109-4450-ab40-70fbd6056674 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 15:38:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:38:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquired lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:38:02 user nova-compute[74658]: DEBUG nova.network.neutron [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:38:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-a6a405bc-1a2f-419a-a164-867af8c10654 req-c3f81860-be30-4666-a962-0cc85326f86e service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-changed-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-a6a405bc-1a2f-419a-a164-867af8c10654 req-c3f81860-be30-4666-a962-0cc85326f86e service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Refreshing instance network info cache due to event network-changed-5c27e2c4-4109-4450-ab40-70fbd6056674. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:38:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a6a405bc-1a2f-419a-a164-867af8c10654 req-c3f81860-be30-4666-a962-0cc85326f86e service nova] Acquiring lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:38:03 user nova-compute[74658]: DEBUG nova.network.neutron [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updating instance_info_cache with network_info: [{"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:38:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Releasing lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:38:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:38:03 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Creating image(s)
Nov 16 15:38:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "/opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "/opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "/opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'trusted_certs' on Instance uuid 396c5838-c4aa-4b02-9b9a-4f3296d85f2f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a6a405bc-1a2f-419a-a164-867af8c10654 req-c3f81860-be30-4666-a962-0cc85326f86e service nova] Acquired lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:38:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-a6a405bc-1a2f-419a-a164-867af8c10654 req-c3f81860-be30-4666-a962-0cc85326f86e service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Refreshing network info cache for port 5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:38:03 user nova-compute[74658]: DEBUG nova.objects.base [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Object Instance<396c5838-c4aa-4b02-9b9a-4f3296d85f2f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:38:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "0aa04802cdee4f6cdc2e6288816dbdad50a6c30e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "0aa04802cdee4f6cdc2e6288816dbdad50a6c30e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e.part --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e.part --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:04 user nova-compute[74658]: DEBUG nova.virt.images [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] cbf34948-773c-481f-a4cd-891e7ff10f21 was qcow2, converting to raw {{(pid=74658) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 15:38:04 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:38:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e.part /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e.converted {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:04 user nova-compute[74658]: DEBUG nova.network.neutron [req-a6a405bc-1a2f-419a-a164-867af8c10654 req-c3f81860-be30-4666-a962-0cc85326f86e service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updated VIF entry in instance network info cache for port 5c27e2c4-4109-4450-ab40-70fbd6056674. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:38:04 user nova-compute[74658]: DEBUG nova.network.neutron [req-a6a405bc-1a2f-419a-a164-867af8c10654 req-c3f81860-be30-4666-a962-0cc85326f86e service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updating instance_info_cache with network_info: [{"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:38:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a6a405bc-1a2f-419a-a164-867af8c10654 req-c3f81860-be30-4666-a962-0cc85326f86e service nova] Releasing lock "refresh_cache-396c5838-c4aa-4b02-9b9a-4f3296d85f2f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e.part /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e.converted" returned: 0 in 0.848s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e.converted --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "0aa04802cdee4f6cdc2e6288816dbdad50a6c30e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.197s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "0aa04802cdee4f6cdc2e6288816dbdad50a6c30e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "0aa04802cdee4f6cdc2e6288816dbdad50a6c30e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e,backing_fmt=raw /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e,backing_fmt=raw /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk 1073741824" returned: 0 in 0.049s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "0aa04802cdee4f6cdc2e6288816dbdad50a6c30e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:06 user nova-compute[74658]: DEBUG nova.objects.instance [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'migration_context' on Instance uuid 396c5838-c4aa-4b02-9b9a-4f3296d85f2f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:06 user nova-compute[74658]: DEBUG nova.objects.base [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Object Instance<396c5838-c4aa-4b02-9b9a-4f3296d85f2f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:38:06 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Rebasing disk image.
Nov 16 15:38:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.257s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 -F raw /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 -F raw /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk" returned: 0 in 2.822s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Ensure instance console log exists: /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Start _get_guest_xml network_info=[{"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a2da3e227fc361ab87925810fa2bbf9f',container_format='bare',created_at=2023-11-16T15:36:09Z,direct_url=<?>,disk_format='qcow2',id=cbf34948-773c-481f-a4cd-891e7ff10f21,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1819937516-shelved',owner='8e355315b27543ccacf00b9461cff1a0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T15:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:38:09 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:38:09 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a2da3e227fc361ab87925810fa2bbf9f',container_format='bare',created_at=2023-11-16T15:36:09Z,direct_url=<?>,disk_format='qcow2',id=cbf34948-773c-481f-a4cd-891e7ff10f21,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1819937516-shelved',owner='8e355315b27543ccacf00b9461cff1a0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T15:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.objects.instance [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'vcpu_model' on Instance uuid 396c5838-c4aa-4b02-9b9a-4f3296d85f2f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.objects.base [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Object Instance<396c5838-c4aa-4b02-9b9a-4f3296d85f2f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819937516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819937516',id=35,image_ref='cbf34948-773c-481f-a4cd-891e7ff10f21',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1533894978',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:34:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-vav0s65l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member',shelved_at='2023-11-16T15:36:12.805873',shelved_host='user',shelved_image_id='cbf34948-773c-481f-a4cd-891e7ff10f21'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=396c5838-c4aa-4b02-9b9a-4f3296d85f2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.objects.instance [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'pci_devices' on Instance uuid 396c5838-c4aa-4b02-9b9a-4f3296d85f2f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.objects.base [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Object Instance<396c5838-c4aa-4b02-9b9a-4f3296d85f2f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:38:09 user nova-compute[74658]:   <uuid>396c5838-c4aa-4b02-9b9a-4f3296d85f2f</uuid>
Nov 16 15:38:09 user nova-compute[74658]:   <name>instance-00000023</name>
Nov 16 15:38:09 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:38:09 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:38:09 user nova-compute[74658]:   <metadata>
Nov 16 15:38:09 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:38:09 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:38:09 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1819937516</nova:name>
Nov 16 15:38:09 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:38:09</nova:creationTime>
Nov 16 15:38:09 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:38:09 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:38:09 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:38:09 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:38:09 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:38:09 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:38:09 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:38:09 user nova-compute[74658]:       <nova:owner>
Nov 16 15:38:09 user nova-compute[74658]:         <nova:user uuid="78e64660311e44e8aec0701ea52c2bb6">tempest-AttachVolumeShelveTestJSON-1521088540-project-member</nova:user>
Nov 16 15:38:09 user nova-compute[74658]:         <nova:project uuid="8e355315b27543ccacf00b9461cff1a0">tempest-AttachVolumeShelveTestJSON-1521088540</nova:project>
Nov 16 15:38:09 user nova-compute[74658]:       </nova:owner>
Nov 16 15:38:09 user nova-compute[74658]:       <nova:root type="image" uuid="cbf34948-773c-481f-a4cd-891e7ff10f21"/>
Nov 16 15:38:09 user nova-compute[74658]:       <nova:ports>
Nov 16 15:38:09 user nova-compute[74658]:         <nova:port uuid="5c27e2c4-4109-4450-ab40-70fbd6056674">
Nov 16 15:38:09 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 15:38:09 user nova-compute[74658]:         </nova:port>
Nov 16 15:38:09 user nova-compute[74658]:       </nova:ports>
Nov 16 15:38:09 user nova-compute[74658]:     </nova:instance>
Nov 16 15:38:09 user nova-compute[74658]:   </metadata>
Nov 16 15:38:09 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:38:09 user nova-compute[74658]:     <system>
Nov 16 15:38:09 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:38:09 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:38:09 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:38:09 user nova-compute[74658]:       <entry name="serial">396c5838-c4aa-4b02-9b9a-4f3296d85f2f</entry>
Nov 16 15:38:09 user nova-compute[74658]:       <entry name="uuid">396c5838-c4aa-4b02-9b9a-4f3296d85f2f</entry>
Nov 16 15:38:09 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:38:09 user nova-compute[74658]:     </system>
Nov 16 15:38:09 user nova-compute[74658]:   </sysinfo>
Nov 16 15:38:09 user nova-compute[74658]:   <os>
Nov 16 15:38:09 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:38:09 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:38:09 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:38:09 user nova-compute[74658]:   </os>
Nov 16 15:38:09 user nova-compute[74658]:   <features>
Nov 16 15:38:09 user nova-compute[74658]:     <acpi/>
Nov 16 15:38:09 user nova-compute[74658]:     <apic/>
Nov 16 15:38:09 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:38:09 user nova-compute[74658]:   </features>
Nov 16 15:38:09 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:38:09 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:38:09 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:38:09 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:38:09 user nova-compute[74658]:   </clock>
Nov 16 15:38:09 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:38:09 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:38:09 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:38:09 user nova-compute[74658]:   </cpu>
Nov 16 15:38:09 user nova-compute[74658]:   <devices>
Nov 16 15:38:09 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:38:09 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:38:09 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk"/>
Nov 16 15:38:09 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:38:09 user nova-compute[74658]:     </disk>
Nov 16 15:38:09 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:38:09 user nova-compute[74658]:       <mac address="fa:16:3e:29:5e:37"/>
Nov 16 15:38:09 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:38:09 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:38:09 user nova-compute[74658]:       <target dev="tap5c27e2c4-41"/>
Nov 16 15:38:09 user nova-compute[74658]:     </interface>
Nov 16 15:38:09 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:38:09 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/console.log" append="off"/>
Nov 16 15:38:09 user nova-compute[74658]:     </serial>
Nov 16 15:38:09 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:38:09 user nova-compute[74658]:     <video>
Nov 16 15:38:09 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:38:09 user nova-compute[74658]:     </video>
Nov 16 15:38:09 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:38:09 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:38:09 user nova-compute[74658]:     </rng>
Nov 16 15:38:09 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:38:09 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:38:09 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:38:09 user nova-compute[74658]:     </memballoon>
Nov 16 15:38:09 user nova-compute[74658]:   </devices>
Nov 16 15:38:09 user nova-compute[74658]: </domain>
Nov 16 15:38:09 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819937516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819937516',id=35,image_ref='cbf34948-773c-481f-a4cd-891e7ff10f21',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1533894978',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:34:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-vav0s65l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member',shelved_at='2023-11-16T15:36:12.805873',shelved_host='user',shelved_image_id='cbf34948-773c-481f-a4cd-891e7ff10f21'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=396c5838-c4aa-4b02-9b9a-4f3296d85f2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG os_vif [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '660edf1a-3e6f-5875-b38d-8e3f8a024350', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c27e2c4-41, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c27e2c4-41, col_values=(('qos', UUID('6942ab3b-2f5e-40ab-8d55-6f6937e1ce6c')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c27e2c4-41, col_values=(('external_ids', {'iface-id': '5c27e2c4-4109-4450-ab40-70fbd6056674', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:5e:37', 'vm-uuid': '396c5838-c4aa-4b02-9b9a-4f3296d85f2f'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:09 user nova-compute[74658]: INFO os_vif [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41')
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] No VIF found with MAC fa:16:3e:29:5e:37, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Updating instance_info_cache with network_info: [{"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:38:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-156bd6fe-6bf0-4ff9-b6d5-5b4675e0c910 req-1b0eb299-9ed6-4ea0-83db-06d70b2ee617 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-156bd6fe-6bf0-4ff9-b6d5-5b4675e0c910 req-1b0eb299-9ed6-4ea0-83db-06d70b2ee617 service nova] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-156bd6fe-6bf0-4ff9-b6d5-5b4675e0c910 req-1b0eb299-9ed6-4ea0-83db-06d70b2ee617 service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-156bd6fe-6bf0-4ff9-b6d5-5b4675e0c910 req-1b0eb299-9ed6-4ea0-83db-06d70b2ee617 service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-156bd6fe-6bf0-4ff9-b6d5-5b4675e0c910 req-1b0eb299-9ed6-4ea0-83db-06d70b2ee617 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] No waiting events found dispatching network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:38:10 user nova-compute[74658]: WARNING nova.compute.manager [req-156bd6fe-6bf0-4ff9-b6d5-5b4675e0c910 req-1b0eb299-9ed6-4ea0-83db-06d70b2ee617 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received unexpected event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 15:38:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:38:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:38:12 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Instance spawned successfully.
Nov 16 15:38:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-f259370c-048c-4d57-acd8-93b5a8aa5bf1 req-35ac41cc-03c1-4351-b1dc-498ceed7a318 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f259370c-048c-4d57-acd8-93b5a8aa5bf1 req-35ac41cc-03c1-4351-b1dc-498ceed7a318 service nova] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f259370c-048c-4d57-acd8-93b5a8aa5bf1 req-35ac41cc-03c1-4351-b1dc-498ceed7a318 service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f259370c-048c-4d57-acd8-93b5a8aa5bf1 req-35ac41cc-03c1-4351-b1dc-498ceed7a318 service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-f259370c-048c-4d57-acd8-93b5a8aa5bf1 req-35ac41cc-03c1-4351-b1dc-498ceed7a318 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] No waiting events found dispatching network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:38:13 user nova-compute[74658]: WARNING nova.compute.manager [req-f259370c-048c-4d57-acd8-93b5a8aa5bf1 req-35ac41cc-03c1-4351-b1dc-498ceed7a318 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received unexpected event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-30afbf95-c401-4702-bd7e-12f766693c0e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.805s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-b56f5263-ee68-43ef-9b0b-1e8a44c335e7 req-5ac79776-54ac-4638-86cf-c01c113da96e service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received event network-changed-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-b56f5263-ee68-43ef-9b0b-1e8a44c335e7 req-5ac79776-54ac-4638-86cf-c01c113da96e service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Refreshing instance network info cache due to event network-changed-62eaa972-e599-49b6-8310-3872c69febdd. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b56f5263-ee68-43ef-9b0b-1e8a44c335e7 req-5ac79776-54ac-4638-86cf-c01c113da96e service nova] Acquiring lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b56f5263-ee68-43ef-9b0b-1e8a44c335e7 req-5ac79776-54ac-4638-86cf-c01c113da96e service nova] Acquired lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-b56f5263-ee68-43ef-9b0b-1e8a44c335e7 req-5ac79776-54ac-4638-86cf-c01c113da96e service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Refreshing network info cache for port 62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-b56f5263-ee68-43ef-9b0b-1e8a44c335e7 req-5ac79776-54ac-4638-86cf-c01c113da96e service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Updated VIF entry in instance network info cache for port 62eaa972-e599-49b6-8310-3872c69febdd. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-b56f5263-ee68-43ef-9b0b-1e8a44c335e7 req-5ac79776-54ac-4638-86cf-c01c113da96e service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Updating instance_info_cache with network_info: [{"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b56f5263-ee68-43ef-9b0b-1e8a44c335e7 req-5ac79776-54ac-4638-86cf-c01c113da96e service nova] Releasing lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:38:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:15 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:38:15 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:38:15 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=25.27252197265625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:38:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 459a4296-6338-49d3-a3ba-f881418f9d7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 68cbf793-b573-44fd-97e2-e43f22c86b45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 396c5838-c4aa-4b02-9b9a-4f3296d85f2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 15:38:17 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 is timed out.
Nov 16 15:38:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully detached device vdb from instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 from the live domain config.
Nov 16 15:38:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZOBpPLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:38:17 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[18af3a61-8ba2-4293-9bf9-00d1cccdc139]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:38:17 user nova-compute[74658]: No targets found.
Nov 16 15:38:17 user nova-compute[74658]: iSNS:
Nov 16 15:38:17 user nova-compute[74658]: No targets found.
Nov 16 15:38:17 user nova-compute[74658]: STATIC:
Nov 16 15:38:17 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e
Nov 16 15:38:17 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:38:17 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:38:17 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c
Nov 16 15:38:17 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:38:17 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:38:17 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014
Nov 16 15:38:17 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:38:17 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:38:17 user nova-compute[74658]: FIRMWARE:
Nov 16 15:38:17 user nova-compute[74658]: No targets found.
Nov 16 15:38:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:38:17 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:38:17 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[962899e8-1c25-4b32-87fe-010f73e906e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[26817673-e502-4075-b706-7f8f8587c80f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:38:17 user nova-compute[74658]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)
Nov 16 15:38:17 user nova-compute[74658]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)
Nov 16 15:38:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:38:17 user nova-compute[74658]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e (non-flash)
Nov 16 15:38:17 user nova-compute[74658]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)
Nov 16 15:38:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07101583a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e'): ({'sdd'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Removing single pathed devices sdd {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1679f5-693c-4718-8192-70ca71f932f1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33ca0e7-1fc1-4e6c-890a-b3f7403caae9]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flushing IO for device /dev/sdd {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae3c30f-0c6a-43c2-84ca-68dcf05af785]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[db675426-604c-4820-8de4-41af14fea298]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb966f2-06b5-4054-a388-9f4e85246b35]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d01eae-4038-4c0c-819d-a626fdb183b6]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e, portal: 172.16.0.220,3260]
Nov 16 15:38:17 user nova-compute[74658]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e, portal: 172.16.0.220,3260] successful.
Nov 16 15:38:17 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65e60fe-cd8b-421b-a015-3dd1192e357e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45b9e5e-e457-403b-bd3a-a8f771d5197e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] <== disconnect_volume: return (331ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:38:19 user nova-compute[74658]: DEBUG nova.objects.instance [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid bbbdb32b-2c3f-4c2f-9395-9c983242e124 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d62197a2-3f6f-48c6-9412-94e466948e2a tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.613s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:19 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:38:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:19 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:38:19 user nova-compute[74658]: INFO nova.compute.claims [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Claim successful on node user
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:38:20 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.policy [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aed7ea9505b3400ebbe1ce456419bc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2156886e7c2247e38a1ffe4025798a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:38:20 user nova-compute[74658]: INFO nova.virt.block_device [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Booting with volume f763db24-ebb0-402c-8c3a-e54a8422ad5b at /dev/vda
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:20 user nova-compute[74658]: INFO nova.compute.manager [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Detaching volume 4a72fac8-1a84-44c7-8d5c-7df85a96b00c
Nov 16 15:38:20 user nova-compute[74658]: DEBUG os_brick.utils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40bcfd1-22c0-4c05-8278-8c2b8624d6c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:20 user nova-compute[74658]: INFO nova.virt.block_device [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Attempting to driver detach volume 4a72fac8-1a84-44c7-8d5c-7df85a96b00c from mountpoint /dev/vdc
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0e19e0-3de1-4eb5-b0af-e9dda1da0ba7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Attempting to detach device vdc from instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:38:20 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:38:20 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:38:20 user nova-compute[74658]:   <target dev="vdc" bus="virtio"/>
Nov 16 15:38:20 user nova-compute[74658]:   <serial>4a72fac8-1a84-44c7-8d5c-7df85a96b00c</serial>
Nov 16 15:38:20 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 15:38:20 user nova-compute[74658]: </disk>
Nov 16 15:38:20 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:38:20 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully detached device vdc from instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 from the persistent domain config.
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:38:20 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:38:20 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:38:20 user nova-compute[74658]:   <target dev="vdc" bus="virtio"/>
Nov 16 15:38:20 user nova-compute[74658]:   <serial>4a72fac8-1a84-44c7-8d5c-7df85a96b00c</serial>
Nov 16 15:38:20 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 15:38:20 user nova-compute[74658]: </disk>
Nov 16 15:38:20 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f519571-e143-46dd-bc1d-db58ea45ed3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab69ba1-a4c8-4a2d-9efd-ed36c323204c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:38:20 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:38:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8261fb0d-c41f-4781-92ca-f605c9ac509a]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG os_brick.utils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:38:20 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Updating existing volume attachment record: eb6e2a6f-e629-43f4-a93b-dc6388c92099 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:38:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:38:21 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Successfully created port: 6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:38:21 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Successfully updated port: 6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:38:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:38:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquired lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:38:21 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:38:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-0f8f81be-9b52-411a-b94e-71f31f70007b req-b7c93ff6-3fbe-41ca-ae93-a98b0f75759f service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received event network-changed-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:21 user nova-compute[74658]: DEBUG nova.compute.manager [req-0f8f81be-9b52-411a-b94e-71f31f70007b req-b7c93ff6-3fbe-41ca-ae93-a98b0f75759f service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Refreshing instance network info cache due to event network-changed-6d4d062f-b33e-49c6-8e7e-9869f7439989. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:38:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f8f81be-9b52-411a-b94e-71f31f70007b req-b7c93ff6-3fbe-41ca-ae93-a98b0f75759f service nova] Acquiring lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:38:21 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:38:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Updating instance_info_cache with network_info: [{"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:38:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Releasing lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:38:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Instance network_info: |[{"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:38:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f8f81be-9b52-411a-b94e-71f31f70007b req-b7c93ff6-3fbe-41ca-ae93-a98b0f75759f service nova] Acquired lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:38:22 user nova-compute[74658]: DEBUG nova.network.neutron [req-0f8f81be-9b52-411a-b94e-71f31f70007b req-b7c93ff6-3fbe-41ca-ae93-a98b0f75759f service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Refreshing network info cache for port 6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:38:22 user nova-compute[74658]: DEBUG nova.network.neutron [req-0f8f81be-9b52-411a-b94e-71f31f70007b req-b7c93ff6-3fbe-41ca-ae93-a98b0f75759f service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Updated VIF entry in instance network info cache for port 6d4d062f-b33e-49c6-8e7e-9869f7439989. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:38:22 user nova-compute[74658]: DEBUG nova.network.neutron [req-0f8f81be-9b52-411a-b94e-71f31f70007b req-b7c93ff6-3fbe-41ca-ae93-a98b0f75759f service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Updating instance_info_cache with network_info: [{"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:38:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f8f81be-9b52-411a-b94e-71f31f70007b req-b7c93ff6-3fbe-41ca-ae93-a98b0f75759f service nova] Releasing lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:38:23 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:38:23 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 15:38:23 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 15:38:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:38:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Creating image(s)
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Ensure instance console log exists: /opt/stack/data/nova/instances/534868c0-fdd2-4f54-b4e8-db28ccaa967f/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Start _get_guest_xml network_info=[{"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'eb6e2a6f-e629-43f4-a93b-dc6388c92099', 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjtZGDLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '534868c0-fdd2-4f54-b4e8-db28ccaa967f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f763db24-ebb0-402c-8c3a-e54a8422ad5b', 'serial': 'f763db24-ebb0-402c-8c3a-e54a8422ad5b'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:38:25 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:38:25 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjtZGDLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:38:25 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:38:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:38:25 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:38:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:38:25 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:38:25 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:38:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c0b0d4-b13d-4981-9a57-2ce9370843bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:38:26 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcae991-e985-4752-90b1-e7ffd202b10a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b] added
Nov 16 15:38:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8738cd02-4ee7-440e-999c-8becba247fc1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b198764c-a8df-4aac-9a8f-30b063cc07e7]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjtZGDLY {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjtZGDLY" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a98395-f4cb-4714-a7bb-d277df5ec392]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OjtZGDLY'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f460a1a-3b8d-448f-a8c2-52aaf476b539]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e51f4e-19b0-48c0-8a2f-0d758dd13c1c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:38:26 user nova-compute[74658]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)
Nov 16 15:38:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:38:26 user nova-compute[74658]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)
Nov 16 15:38:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e32b3f-f7e0-4861-966f-72e9be2052ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b, portal: 172.16.0.220,3260]
Nov 16 15:38:26 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b, portal: 172.16.0.220,3260] successful.
Nov 16 15:38:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f59f155-69dd-4659-9600-35dafcf23fed]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb85f22-dec3-45a4-aec2-8be8f7c7dec1]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:38:26 user nova-compute[74658]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)
Nov 16 15:38:26 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:38:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:38:26 user nova-compute[74658]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)
Nov 16 15:38:26 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:38:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f434f9ce-10f9-4a7b-b4f0-f82341429014]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:38:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjtZGDLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23734343037313538', 'path': '/dev/sdd'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734343037313538', 'path': '/dev/sdd'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1180337277',display_name='tempest-TestVolumeBootPattern-server-1180337277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1180337277',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa3gqCorV1WbIg5i//0wnlopR+3KlyeNwvcR7SHxTAoz1md6ZPUq6Nr5c+6nYZB4Ns6g0kjBKvILHRe+adcrSzLJ8v98clK+l5Pw4QpWw7oSlS+Kt7nCSty+cuvnOaubg==',key_name='tempest-TestVolumeBootPattern-1945158636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-9btrh0ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:38:20Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=534868c0-fdd2-4f54-b4e8-db28ccaa967f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:5c:ff,bridge_name='br-int',has_traffic_filtering=True,id=6d4d062f-b33e-49c6-8e7e-9869f7439989,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4d062f-b3') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'pci_devices' on Instance uuid 534868c0-fdd2-4f54-b4e8-db28ccaa967f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:38:27 user nova-compute[74658]:   <uuid>534868c0-fdd2-4f54-b4e8-db28ccaa967f</uuid>
Nov 16 15:38:27 user nova-compute[74658]:   <name>instance-0000002a</name>
Nov 16 15:38:27 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:38:27 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:38:27 user nova-compute[74658]:   <metadata>
Nov 16 15:38:27 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:38:27 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:38:27 user nova-compute[74658]:       <nova:name>tempest-TestVolumeBootPattern-server-1180337277</nova:name>
Nov 16 15:38:27 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:38:25</nova:creationTime>
Nov 16 15:38:27 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:38:27 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:38:27 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:38:27 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:38:27 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:38:27 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:38:27 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:38:27 user nova-compute[74658]:       <nova:owner>
Nov 16 15:38:27 user nova-compute[74658]:         <nova:user uuid="aed7ea9505b3400ebbe1ce456419bc82">tempest-TestVolumeBootPattern-1853010836-project-member</nova:user>
Nov 16 15:38:27 user nova-compute[74658]:         <nova:project uuid="2156886e7c2247e38a1ffe4025798a96">tempest-TestVolumeBootPattern-1853010836</nova:project>
Nov 16 15:38:27 user nova-compute[74658]:       </nova:owner>
Nov 16 15:38:27 user nova-compute[74658]:       <nova:ports>
Nov 16 15:38:27 user nova-compute[74658]:         <nova:port uuid="6d4d062f-b33e-49c6-8e7e-9869f7439989">
Nov 16 15:38:27 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 15:38:27 user nova-compute[74658]:         </nova:port>
Nov 16 15:38:27 user nova-compute[74658]:       </nova:ports>
Nov 16 15:38:27 user nova-compute[74658]:     </nova:instance>
Nov 16 15:38:27 user nova-compute[74658]:   </metadata>
Nov 16 15:38:27 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:38:27 user nova-compute[74658]:     <system>
Nov 16 15:38:27 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:38:27 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:38:27 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:38:27 user nova-compute[74658]:       <entry name="serial">534868c0-fdd2-4f54-b4e8-db28ccaa967f</entry>
Nov 16 15:38:27 user nova-compute[74658]:       <entry name="uuid">534868c0-fdd2-4f54-b4e8-db28ccaa967f</entry>
Nov 16 15:38:27 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:38:27 user nova-compute[74658]:     </system>
Nov 16 15:38:27 user nova-compute[74658]:   </sysinfo>
Nov 16 15:38:27 user nova-compute[74658]:   <os>
Nov 16 15:38:27 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:38:27 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:38:27 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:38:27 user nova-compute[74658]:   </os>
Nov 16 15:38:27 user nova-compute[74658]:   <features>
Nov 16 15:38:27 user nova-compute[74658]:     <acpi/>
Nov 16 15:38:27 user nova-compute[74658]:     <apic/>
Nov 16 15:38:27 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:38:27 user nova-compute[74658]:   </features>
Nov 16 15:38:27 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:38:27 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:38:27 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:38:27 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:38:27 user nova-compute[74658]:   </clock>
Nov 16 15:38:27 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:38:27 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:38:27 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:38:27 user nova-compute[74658]:   </cpu>
Nov 16 15:38:27 user nova-compute[74658]:   <devices>
Nov 16 15:38:27 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:38:27 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:38:27 user nova-compute[74658]:       <source dev="/dev/sdd"/>
Nov 16 15:38:27 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:38:27 user nova-compute[74658]:       <serial>f763db24-ebb0-402c-8c3a-e54a8422ad5b</serial>
Nov 16 15:38:27 user nova-compute[74658]:     </disk>
Nov 16 15:38:27 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:38:27 user nova-compute[74658]:       <mac address="fa:16:3e:55:5c:ff"/>
Nov 16 15:38:27 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:38:27 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:38:27 user nova-compute[74658]:       <target dev="tap6d4d062f-b3"/>
Nov 16 15:38:27 user nova-compute[74658]:     </interface>
Nov 16 15:38:27 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:38:27 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/534868c0-fdd2-4f54-b4e8-db28ccaa967f/console.log" append="off"/>
Nov 16 15:38:27 user nova-compute[74658]:     </serial>
Nov 16 15:38:27 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:38:27 user nova-compute[74658]:     <video>
Nov 16 15:38:27 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:38:27 user nova-compute[74658]:     </video>
Nov 16 15:38:27 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:38:27 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:38:27 user nova-compute[74658]:     </rng>
Nov 16 15:38:27 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:38:27 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:38:27 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:38:27 user nova-compute[74658]:     </memballoon>
Nov 16 15:38:27 user nova-compute[74658]:   </devices>
Nov 16 15:38:27 user nova-compute[74658]: </domain>
Nov 16 15:38:27 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1180337277',display_name='tempest-TestVolumeBootPattern-server-1180337277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1180337277',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa3gqCorV1WbIg5i//0wnlopR+3KlyeNwvcR7SHxTAoz1md6ZPUq6Nr5c+6nYZB4Ns6g0kjBKvILHRe+adcrSzLJ8v98clK+l5Pw4QpWw7oSlS+Kt7nCSty+cuvnOaubg==',key_name='tempest-TestVolumeBootPattern-1945158636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-9btrh0ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:38:20Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=534868c0-fdd2-4f54-b4e8-db28ccaa967f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:5c:ff,bridge_name='br-int',has_traffic_filtering=True,id=6d4d062f-b33e-49c6-8e7e-9869f7439989,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4d062f-b3') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG os_vif [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:5c:ff,bridge_name='br-int',has_traffic_filtering=True,id=6d4d062f-b33e-49c6-8e7e-9869f7439989,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4d062f-b3') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3b12e44-e1b7-5fed-91fa-9bf455146287', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d4d062f-b3, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d4d062f-b3, col_values=(('qos', UUID('a5b9449c-23e4-409f-8afc-b4ada35f4126')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d4d062f-b3, col_values=(('external_ids', {'iface-id': '6d4d062f-b33e-49c6-8e7e-9869f7439989', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:5c:ff', 'vm-uuid': '534868c0-fdd2-4f54-b4e8-db28ccaa967f'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:27 user nova-compute[74658]: INFO os_vif [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:5c:ff,bridge_name='br-int',has_traffic_filtering=True,id=6d4d062f-b33e-49c6-8e7e-9869f7439989,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4d062f-b3')
Nov 16 15:38:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:38:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] No VIF found with MAC fa:16:3e:55:5c:ff, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:38:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-f9fca78f-a156-45ce-becb-a47fb605b7dd req-2bfcb1e6-bf2f-4b15-aa41-cec080fd92b9 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received event network-vif-plugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f9fca78f-a156-45ce-becb-a47fb605b7dd req-2bfcb1e6-bf2f-4b15-aa41-cec080fd92b9 service nova] Acquiring lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f9fca78f-a156-45ce-becb-a47fb605b7dd req-2bfcb1e6-bf2f-4b15-aa41-cec080fd92b9 service nova] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f9fca78f-a156-45ce-becb-a47fb605b7dd req-2bfcb1e6-bf2f-4b15-aa41-cec080fd92b9 service nova] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-f9fca78f-a156-45ce-becb-a47fb605b7dd req-2bfcb1e6-bf2f-4b15-aa41-cec080fd92b9 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] No waiting events found dispatching network-vif-plugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:38:29 user nova-compute[74658]: WARNING nova.compute.manager [req-f9fca78f-a156-45ce-becb-a47fb605b7dd req-2bfcb1e6-bf2f-4b15-aa41-cec080fd92b9 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received unexpected event network-vif-plugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 for instance with vm_state building and task_state spawning.
Nov 16 15:38:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:38:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:38:30 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Instance spawned successfully.
Nov 16 15:38:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:38:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:38:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:38:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:38:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:38:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:38:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:38:30 user nova-compute[74658]: INFO nova.compute.manager [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 16 15:38:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:38:30 user nova-compute[74658]: INFO nova.compute.manager [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Took 11.09 seconds to build instance.
Nov 16 15:38:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2a9808fc-8d29-407a-a124-3b0ee3a9e1a8 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.186s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-e59f1def-b4fb-4561-ad4c-83c439300753 req-002a68b2-2fc0-4263-a5e8-ec1b7d209830 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received event network-vif-plugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e59f1def-b4fb-4561-ad4c-83c439300753 req-002a68b2-2fc0-4263-a5e8-ec1b7d209830 service nova] Acquiring lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e59f1def-b4fb-4561-ad4c-83c439300753 req-002a68b2-2fc0-4263-a5e8-ec1b7d209830 service nova] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e59f1def-b4fb-4561-ad4c-83c439300753 req-002a68b2-2fc0-4263-a5e8-ec1b7d209830 service nova] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-e59f1def-b4fb-4561-ad4c-83c439300753 req-002a68b2-2fc0-4263-a5e8-ec1b7d209830 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] No waiting events found dispatching network-vif-plugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:38:31 user nova-compute[74658]: WARNING nova.compute.manager [req-e59f1def-b4fb-4561-ad4c-83c439300753 req-002a68b2-2fc0-4263-a5e8-ec1b7d209830 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received unexpected event network-vif-plugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 for instance with vm_state active and task_state None.
Nov 16 15:38:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:41 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 is timed out.
Nov 16 15:38:41 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully detached device vdc from instance bbbdb32b-2c3f-4c2f-9395-9c983242e124 from the live domain config.
Nov 16 15:38:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIQSxoOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:38:41 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1321f832-627e-4b51-a3d3-630151030b4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:38:41 user nova-compute[74658]: No targets found.
Nov 16 15:38:41 user nova-compute[74658]: iSNS:
Nov 16 15:38:41 user nova-compute[74658]: No targets found.
Nov 16 15:38:41 user nova-compute[74658]: STATIC:
Nov 16 15:38:41 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c
Nov 16 15:38:41 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:38:41 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:38:41 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014
Nov 16 15:38:41 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:38:41 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:38:41 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b
Nov 16 15:38:41 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:38:41 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:38:41 user nova-compute[74658]: FIRMWARE:
Nov 16 15:38:41 user nova-compute[74658]: No targets found.
Nov 16 15:38:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:38:41 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:38:41 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdbeb1f-8c90-45bf-8f1a-d88a5719274a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1007dd22-1fc4-44b3-ae45-6e84ad9df287]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:38:41 user nova-compute[74658]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)
Nov 16 15:38:41 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:38:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:38:41 user nova-compute[74658]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c (non-flash)
Nov 16 15:38:41 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:38:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710141360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ca10ee-7b17-44d5-b33c-236595d3350f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[83143545-e875-4219-b525-3936d5c48923]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[749da5d2-f4ab-4dd5-b037-620b6a505c7b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b9e02c-80df-43db-8a51-2938c2dc9108]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10c8fc1-febf-4319-a181-f62116d60903]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4081f6f5-a5b6-43f6-b5d1-909e32884ed7]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c, portal: 172.16.0.220,3260]
Nov 16 15:38:41 user nova-compute[74658]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c, portal: 172.16.0.220,3260] successful.
Nov 16 15:38:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a72fac8-1a84-44c7-8d5c-7df85a96b00c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db7dce1-2e0a-4ec7-9093-c169eef5f4e0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] <== disconnect_volume: return (321ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:38:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:38:42 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'flavor' on Instance uuid bbbdb32b-2c3f-4c2f-9395-9c983242e124 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ee3bbc3f-4b39-41f8-9c76-169cb15f2d18 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.649s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:43 user nova-compute[74658]: INFO nova.compute.manager [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Terminating instance
Nov 16 15:38:43 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-ec760f88-3907-4dfd-9c2d-dac856069ab3 req-757e805a-bb1e-4cf5-bf8c-a90e3c45953e service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Received event network-vif-unplugged-f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec760f88-3907-4dfd-9c2d-dac856069ab3 req-757e805a-bb1e-4cf5-bf8c-a90e3c45953e service nova] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec760f88-3907-4dfd-9c2d-dac856069ab3 req-757e805a-bb1e-4cf5-bf8c-a90e3c45953e service nova] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec760f88-3907-4dfd-9c2d-dac856069ab3 req-757e805a-bb1e-4cf5-bf8c-a90e3c45953e service nova] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-ec760f88-3907-4dfd-9c2d-dac856069ab3 req-757e805a-bb1e-4cf5-bf8c-a90e3c45953e service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] No waiting events found dispatching network-vif-unplugged-f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:38:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-ec760f88-3907-4dfd-9c2d-dac856069ab3 req-757e805a-bb1e-4cf5-bf8c-a90e3c45953e service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Received event network-vif-unplugged-f85390fc-0174-409a-93c1-88f17f39eb94 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:38:44 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Instance destroyed successfully.
Nov 16 15:38:44 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lazy-loading 'resources' on Instance uuid bbbdb32b-2c3f-4c2f-9395-9c983242e124 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-32973506',display_name='tempest-AttachVolumeTestJSON-server-32973506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-32973506',id=36,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2XAa3fCdVzLYCYiGigm2gUTY6u2a2XNf9SGp5OhHG9idibjsWcYWh+xWK64o44LnyizHDQpHWnc5WOWXZdjRVwandS3PhlqFMfOnti7GdzSJqaR1FoALelAIXJVZwhHA==',key_name='tempest-keypair-1325275752',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='634ad79271c9408da094067dd3c209d7',ramdisk_id='',reservation_id='r-fgef46m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1830126630',owner_user_name='tempest-AttachVolumeTestJSON-1830126630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:35:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04b6f7159cc4358a2978e9c97aa2dfc',uuid=bbbdb32b-2c3f-4c2f-9395-9c983242e124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converting VIF {"id": "f85390fc-0174-409a-93c1-88f17f39eb94", "address": "fa:16:3e:10:18:c0", "network": {"id": "38e89b52-7a54-4a67-9ea0-2d4429e0217e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2138389774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "634ad79271c9408da094067dd3c209d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85390fc-01", "ovs_interfaceid": "f85390fc-0174-409a-93c1-88f17f39eb94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:18:c0,bridge_name='br-int',has_traffic_filtering=True,id=f85390fc-0174-409a-93c1-88f17f39eb94,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85390fc-01') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG os_vif [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:18:c0,bridge_name='br-int',has_traffic_filtering=True,id=f85390fc-0174-409a-93c1-88f17f39eb94,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85390fc-01') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf85390fc-01, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d19afcc-65f1-49c0-82d1-fd225e07d537) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:44 user nova-compute[74658]: INFO os_vif [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:18:c0,bridge_name='br-int',has_traffic_filtering=True,id=f85390fc-0174-409a-93c1-88f17f39eb94,network=Network(38e89b52-7a54-4a67-9ea0-2d4429e0217e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85390fc-01')
Nov 16 15:38:44 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Deleting instance files /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124_del
Nov 16 15:38:44 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Deletion of /opt/stack/data/nova/instances/bbbdb32b-2c3f-4c2f-9395-9c983242e124_del complete
Nov 16 15:38:44 user nova-compute[74658]: INFO nova.compute.manager [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 15:38:44 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:38:44 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Took 0.58 seconds to deallocate network for instance.
Nov 16 15:38:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:38:44 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:38:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:45 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Deleted allocations for instance bbbdb32b-2c3f-4c2f-9395-9c983242e124
Nov 16 15:38:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b909c5f0-cfbf-46ac-9304-2ebfd144c917 tempest-AttachVolumeTestJSON-1830126630 tempest-AttachVolumeTestJSON-1830126630-project-member] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.899s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-4ae63587-5ac7-4b80-b323-084f2c50dd66 req-78532310-c041-47ea-aca2-e64e0dae034b service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Received event network-vif-plugged-f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4ae63587-5ac7-4b80-b323-084f2c50dd66 req-78532310-c041-47ea-aca2-e64e0dae034b service nova] Acquiring lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4ae63587-5ac7-4b80-b323-084f2c50dd66 req-78532310-c041-47ea-aca2-e64e0dae034b service nova] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4ae63587-5ac7-4b80-b323-084f2c50dd66 req-78532310-c041-47ea-aca2-e64e0dae034b service nova] Lock "bbbdb32b-2c3f-4c2f-9395-9c983242e124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-4ae63587-5ac7-4b80-b323-084f2c50dd66 req-78532310-c041-47ea-aca2-e64e0dae034b service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] No waiting events found dispatching network-vif-plugged-f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:38:45 user nova-compute[74658]: WARNING nova.compute.manager [req-4ae63587-5ac7-4b80-b323-084f2c50dd66 req-78532310-c041-47ea-aca2-e64e0dae034b service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Received unexpected event network-vif-plugged-f85390fc-0174-409a-93c1-88f17f39eb94 for instance with vm_state deleted and task_state None.
Nov 16 15:38:45 user nova-compute[74658]: DEBUG nova.compute.manager [req-4ae63587-5ac7-4b80-b323-084f2c50dd66 req-78532310-c041-47ea-aca2-e64e0dae034b service nova] [instance: bbbdb32b-2c3f-4c2f-9395-9c983242e124] Received event network-vif-deleted-f85390fc-0174-409a-93c1-88f17f39eb94 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:50 user nova-compute[74658]: INFO nova.compute.manager [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Rescuing
Nov 16 15:38:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:38:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquired lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:38:50 user nova-compute[74658]: DEBUG nova.network.neutron [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG nova.network.neutron [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updating instance_info_cache with network_info: [{"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Releasing lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-67bf54a5-a2f8-489b-847a-bbcb24697910 req-3741fd3f-238b-4efc-a7dc-4444789e6273 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received event network-vif-unplugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-67bf54a5-a2f8-489b-847a-bbcb24697910 req-3741fd3f-238b-4efc-a7dc-4444789e6273 service nova] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-67bf54a5-a2f8-489b-847a-bbcb24697910 req-3741fd3f-238b-4efc-a7dc-4444789e6273 service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-67bf54a5-a2f8-489b-847a-bbcb24697910 req-3741fd3f-238b-4efc-a7dc-4444789e6273 service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-67bf54a5-a2f8-489b-847a-bbcb24697910 req-3741fd3f-238b-4efc-a7dc-4444789e6273 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] No waiting events found dispatching network-vif-unplugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:38:51 user nova-compute[74658]: WARNING nova.compute.manager [req-67bf54a5-a2f8-489b-847a-bbcb24697910 req-3741fd3f-238b-4efc-a7dc-4444789e6273 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received unexpected event network-vif-unplugged-ff0bce81-b59f-40d5-a192-d0761ba5709b for instance with vm_state active and task_state rescuing.
Nov 16 15:38:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:51 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Instance destroyed successfully.
Nov 16 15:38:51 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Attempting rescue
Nov 16 15:38:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74658) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Instance directory exists: not creating {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 15:38:51 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Creating image(s)
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ec5f4b8-e749-4121-9206-4e8ddf45981d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue" returned: 0 in 0.054s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'migration_context' on Instance uuid 7ec5f4b8-e749-4121-9206-4e8ddf45981d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG nova.objects.base [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<7ec5f4b8-e749-4121-9206-4e8ddf45981d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Start _get_guest_xml network_info=[{"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "vif_mac": "fa:16:3e:eb:c3:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:38:51 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'resources' on Instance uuid 7ec5f4b8-e749-4121-9206-4e8ddf45981d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.objects.base [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<7ec5f4b8-e749-4121-9206-4e8ddf45981d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ec5f4b8-e749-4121-9206-4e8ddf45981d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.objects.base [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<7ec5f4b8-e749-4121-9206-4e8ddf45981d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:38:52 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:38:52 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ec5f4b8-e749-4121-9206-4e8ddf45981d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.objects.base [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<7ec5f4b8-e749-4121-9206-4e8ddf45981d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1366088746',display_name='tempest-ServerRescueNegativeTestJSON-server-1366088746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1366088746',id=40,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:37:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-s7spn2os',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:37:08Z,user_data=None,user_id='9a638862f3424fda9cd0a29b76596857',uuid=7ec5f4b8-e749-4121-9206-4e8ddf45981d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "vif_mac": "fa:16:3e:eb:c3:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "vif_mac": "fa:16:3e:eb:c3:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:c3:f5,bridge_name='br-int',has_traffic_filtering=True,id=ff0bce81-b59f-40d5-a192-d0761ba5709b,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0bce81-b5') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ec5f4b8-e749-4121-9206-4e8ddf45981d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.objects.base [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<7ec5f4b8-e749-4121-9206-4e8ddf45981d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:38:52 user nova-compute[74658]:   <uuid>7ec5f4b8-e749-4121-9206-4e8ddf45981d</uuid>
Nov 16 15:38:52 user nova-compute[74658]:   <name>instance-00000028</name>
Nov 16 15:38:52 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:38:52 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:38:52 user nova-compute[74658]:   <metadata>
Nov 16 15:38:52 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:38:52 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:38:52 user nova-compute[74658]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1366088746</nova:name>
Nov 16 15:38:52 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:38:52</nova:creationTime>
Nov 16 15:38:52 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:38:52 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:38:52 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:38:52 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:38:52 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:38:52 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:38:52 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:38:52 user nova-compute[74658]:       <nova:owner>
Nov 16 15:38:52 user nova-compute[74658]:         <nova:user uuid="9a638862f3424fda9cd0a29b76596857">tempest-ServerRescueNegativeTestJSON-1957488214-project-member</nova:user>
Nov 16 15:38:52 user nova-compute[74658]:         <nova:project uuid="681f27eda6c74c20be18669837ace195">tempest-ServerRescueNegativeTestJSON-1957488214</nova:project>
Nov 16 15:38:52 user nova-compute[74658]:       </nova:owner>
Nov 16 15:38:52 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:38:52 user nova-compute[74658]:       <nova:ports>
Nov 16 15:38:52 user nova-compute[74658]:         <nova:port uuid="ff0bce81-b59f-40d5-a192-d0761ba5709b">
Nov 16 15:38:52 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 15:38:52 user nova-compute[74658]:         </nova:port>
Nov 16 15:38:52 user nova-compute[74658]:       </nova:ports>
Nov 16 15:38:52 user nova-compute[74658]:     </nova:instance>
Nov 16 15:38:52 user nova-compute[74658]:   </metadata>
Nov 16 15:38:52 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:38:52 user nova-compute[74658]:     <system>
Nov 16 15:38:52 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:38:52 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:38:52 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:38:52 user nova-compute[74658]:       <entry name="serial">7ec5f4b8-e749-4121-9206-4e8ddf45981d</entry>
Nov 16 15:38:52 user nova-compute[74658]:       <entry name="uuid">7ec5f4b8-e749-4121-9206-4e8ddf45981d</entry>
Nov 16 15:38:52 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:38:52 user nova-compute[74658]:     </system>
Nov 16 15:38:52 user nova-compute[74658]:   </sysinfo>
Nov 16 15:38:52 user nova-compute[74658]:   <os>
Nov 16 15:38:52 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:38:52 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:38:52 user nova-compute[74658]:   </os>
Nov 16 15:38:52 user nova-compute[74658]:   <features>
Nov 16 15:38:52 user nova-compute[74658]:     <acpi/>
Nov 16 15:38:52 user nova-compute[74658]:     <apic/>
Nov 16 15:38:52 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:38:52 user nova-compute[74658]:   </features>
Nov 16 15:38:52 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:38:52 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:38:52 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:38:52 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:38:52 user nova-compute[74658]:   </clock>
Nov 16 15:38:52 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:38:52 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:38:52 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:38:52 user nova-compute[74658]:   </cpu>
Nov 16 15:38:52 user nova-compute[74658]:   <devices>
Nov 16 15:38:52 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:38:52 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:38:52 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue"/>
Nov 16 15:38:52 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:38:52 user nova-compute[74658]:     </disk>
Nov 16 15:38:52 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:38:52 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:38:52 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk"/>
Nov 16 15:38:52 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:38:52 user nova-compute[74658]:     </disk>
Nov 16 15:38:52 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:38:52 user nova-compute[74658]:       <mac address="fa:16:3e:eb:c3:f5"/>
Nov 16 15:38:52 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:38:52 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:38:52 user nova-compute[74658]:       <target dev="tapff0bce81-b5"/>
Nov 16 15:38:52 user nova-compute[74658]:     </interface>
Nov 16 15:38:52 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:38:52 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/console.log" append="off"/>
Nov 16 15:38:52 user nova-compute[74658]:     </serial>
Nov 16 15:38:52 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:38:52 user nova-compute[74658]:     <video>
Nov 16 15:38:52 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:38:52 user nova-compute[74658]:     </video>
Nov 16 15:38:52 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:38:52 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:38:52 user nova-compute[74658]:     </rng>
Nov 16 15:38:52 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:38:52 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:38:52 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:38:52 user nova-compute[74658]:     </memballoon>
Nov 16 15:38:52 user nova-compute[74658]:   </devices>
Nov 16 15:38:52 user nova-compute[74658]: </domain>
Nov 16 15:38:52 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:38:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Instance destroyed successfully.
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:38:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No VIF found with MAC fa:16:3e:eb:c3:f5, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:38:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-8f2a1e6f-3219-4a71-a377-22188914c9c8 req-d252a088-4517-4b0f-931a-0bafa746df0a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8f2a1e6f-3219-4a71-a377-22188914c9c8 req-d252a088-4517-4b0f-931a-0bafa746df0a service nova] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8f2a1e6f-3219-4a71-a377-22188914c9c8 req-d252a088-4517-4b0f-931a-0bafa746df0a service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8f2a1e6f-3219-4a71-a377-22188914c9c8 req-d252a088-4517-4b0f-931a-0bafa746df0a service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:53 user nova-compute[74658]: DEBUG nova.compute.manager [req-8f2a1e6f-3219-4a71-a377-22188914c9c8 req-d252a088-4517-4b0f-931a-0bafa746df0a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] No waiting events found dispatching network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:38:53 user nova-compute[74658]: WARNING nova.compute.manager [req-8f2a1e6f-3219-4a71-a377-22188914c9c8 req-d252a088-4517-4b0f-931a-0bafa746df0a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received unexpected event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b for instance with vm_state active and task_state rescuing.
Nov 16 15:38:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] No waiting events found dispatching network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:38:55 user nova-compute[74658]: WARNING nova.compute.manager [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received unexpected event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b for instance with vm_state active and task_state rescuing.
Nov 16 15:38:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:38:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:38:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:38:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:38:55 user nova-compute[74658]: DEBUG nova.compute.manager [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] No waiting events found dispatching network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:38:55 user nova-compute[74658]: WARNING nova.compute.manager [req-db549030-a9dc-45d0-ad39-3370834cf879 req-301ecb68-ca1a-40a7-b654-4a968558e811 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received unexpected event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b for instance with vm_state active and task_state rescuing.
Nov 16 15:38:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-8ae92804-1abc-4a38-910c-b94278465c6d tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:38:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:38:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-8eadc72f-e71a-4770-a9b0-8ff54fb82584 req-137cc9ec-0063-4c22-8b1e-ef308acb9213 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Received event network-changed-9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:39:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-8eadc72f-e71a-4770-a9b0-8ff54fb82584 req-137cc9ec-0063-4c22-8b1e-ef308acb9213 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Refreshing instance network info cache due to event network-changed-9461bfd8-5aea-45ee-9241-b95b771cf460. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:39:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8eadc72f-e71a-4770-a9b0-8ff54fb82584 req-137cc9ec-0063-4c22-8b1e-ef308acb9213 service nova] Acquiring lock "refresh_cache-68cbf793-b573-44fd-97e2-e43f22c86b45" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:39:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8eadc72f-e71a-4770-a9b0-8ff54fb82584 req-137cc9ec-0063-4c22-8b1e-ef308acb9213 service nova] Acquired lock "refresh_cache-68cbf793-b573-44fd-97e2-e43f22c86b45" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:39:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-8eadc72f-e71a-4770-a9b0-8ff54fb82584 req-137cc9ec-0063-4c22-8b1e-ef308acb9213 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Refreshing network info cache for port 9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:39:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-8eadc72f-e71a-4770-a9b0-8ff54fb82584 req-137cc9ec-0063-4c22-8b1e-ef308acb9213 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Updated VIF entry in instance network info cache for port 9461bfd8-5aea-45ee-9241-b95b771cf460. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:39:01 user nova-compute[74658]: DEBUG nova.network.neutron [req-8eadc72f-e71a-4770-a9b0-8ff54fb82584 req-137cc9ec-0063-4c22-8b1e-ef308acb9213 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Updating instance_info_cache with network_info: [{"id": "9461bfd8-5aea-45ee-9241-b95b771cf460", "address": "fa:16:3e:05:74:46", "network": {"id": "b97deb7d-4ac9-46a0-b8bb-c65ef92e892b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-692810974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2be0dc9ded2d4a638a2f17c7c2a6c1c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9461bfd8-5a", "ovs_interfaceid": "9461bfd8-5aea-45ee-9241-b95b771cf460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:39:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8eadc72f-e71a-4770-a9b0-8ff54fb82584 req-137cc9ec-0063-4c22-8b1e-ef308acb9213 service nova] Releasing lock "refresh_cache-68cbf793-b573-44fd-97e2-e43f22c86b45" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "68cbf793-b573-44fd-97e2-e43f22c86b45" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lazy-loading 'flavor' on Instance uuid 68cbf793-b573-44fd-97e2-e43f22c86b45 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "68cbf793-b573-44fd-97e2-e43f22c86b45" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:03 user nova-compute[74658]: INFO nova.compute.manager [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Attaching volume f8b37465-3961-42d2-9344-fda36d69e580 to /dev/vdb
Nov 16 15:39:03 user nova-compute[74658]: DEBUG os_brick.utils [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c70fc0-e454-4dc2-ab21-614642249c68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0a4b68-d39d-489f-be56-51a46500b9a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a2b1a8-4541-4722-86c4-3f6d8c014d37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04b65fa-92c2-45d5-a83c-53d4564e7195]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:03 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:39:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:39:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:39:04 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:39:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[364bbaeb-0d7d-46c2-938f-d538216d77ac]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:39:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:39:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:39:04 user nova-compute[74658]: DEBUG os_brick.utils [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:39:04 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Updating existing volume attachment record: 7bc7a39c-ebd9-4c33-ae35-651440112d7b {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:39:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuGaHCZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:39:08 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:39:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:39:08 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:39:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:39:08 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:39:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad76fe0-7cde-426b-adfe-9744f6cb00e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:39:08 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca5afeb-ff94-42b4-9939-4df6c5d438bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580] added
Nov 16 15:39:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc5d2d3-6c8e-498a-b842-8134113dd55b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8abf53-e45c-41c7-b77d-ac0973056d9f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuGaHCZI {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuGaHCZI" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[079916a4-4474-4eb7-9eec-1cd86b82821f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UuGaHCZI'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdaf804-3e72-468f-88a2-7879f19a1f0f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda74740-4744-4027-a306-b138ce1bc8bf]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:39:09 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:39:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:39:09 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:39:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[723fa0de-5b0d-430d-b2fc-9774d0abd931]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580, portal: 172.16.0.220,3260]
Nov 16 15:39:09 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580, portal: 172.16.0.220,3260] successful.
Nov 16 15:39:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[db41cf77-ed7d-41ef-b9f3-46a9315e752d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[410f31f9-9c94-4b22-9f29-608a50f3f7f0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:39:09 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:39:09 user nova-compute[74658]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 (non-flash)
Nov 16 15:39:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:39:09 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:39:09 user nova-compute[74658]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 (non-flash)
Nov 16 15:39:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa0801c-6e52-4562-ba7b-6a83a2a1be0e]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuGaHCZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26138623430613930', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138623430613930', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lazy-loading 'flavor' on Instance uuid 68cbf793-b573-44fd-97e2-e43f22c86b45 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:39:10 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:39:10 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:39:10 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:39:10 user nova-compute[74658]:   <serial>f8b37465-3961-42d2-9344-fda36d69e580</serial>
Nov 16 15:39:10 user nova-compute[74658]: </disk>
Nov 16 15:39:10 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] No VIF found with MAC fa:16:3e:05:74:46, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:39:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b7eb853f-fbb7-4796-a862-d6c73e66d52f tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.953s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:39:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:39:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:39:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:39:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:39:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updating instance_info_cache with network_info: [{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:39:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:39:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:39:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:39:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "68cbf793-b573-44fd-97e2-e43f22c86b45" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:13 user nova-compute[74658]: INFO nova.compute.manager [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Detaching volume f8b37465-3961-42d2-9344-fda36d69e580
Nov 16 15:39:13 user nova-compute[74658]: INFO nova.virt.block_device [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Attempting to driver detach volume f8b37465-3961-42d2-9344-fda36d69e580 from mountpoint /dev/vdb
Nov 16 15:39:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Attempting to detach device vdb from instance 68cbf793-b573-44fd-97e2-e43f22c86b45 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:39:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:39:13 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:39:13 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:39:13 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:39:13 user nova-compute[74658]:   <serial>f8b37465-3961-42d2-9344-fda36d69e580</serial>
Nov 16 15:39:13 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:39:13 user nova-compute[74658]: </disk>
Nov 16 15:39:13 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:39:13 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Successfully detached device vdb from instance 68cbf793-b573-44fd-97e2-e43f22c86b45 from the persistent domain config.
Nov 16 15:39:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68cbf793-b573-44fd-97e2-e43f22c86b45 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:39:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:39:13 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:39:13 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:39:13 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:39:13 user nova-compute[74658]:   <serial>f8b37465-3961-42d2-9344-fda36d69e580</serial>
Nov 16 15:39:13 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:39:13 user nova-compute[74658]: </disk>
Nov 16 15:39:13 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:39:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68cbf793-b573-44fd-97e2-e43f22c86b45 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:39:16 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:39:16 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8243MB free_disk=25.29625701904297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 459a4296-6338-49d3-a3ba-f881418f9d7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 68cbf793-b573-44fd-97e2-e43f22c86b45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 396c5838-c4aa-4b02-9b9a-4f3296d85f2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 534868c0-fdd2-4f54-b4e8-db28ccaa967f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:39:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:17 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:39:18 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:39:18 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:39:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:21 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:39:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:39:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:33 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 68cbf793-b573-44fd-97e2-e43f22c86b45 is timed out.
Nov 16 15:39:33 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Successfully detached device vdb from instance 68cbf793-b573-44fd-97e2-e43f22c86b45 from the live domain config.
Nov 16 15:39:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuGaHCZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:39:33 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c666eb7-6096-425d-8002-514b68b1a723]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:39:33 user nova-compute[74658]: No targets found.
Nov 16 15:39:33 user nova-compute[74658]: iSNS:
Nov 16 15:39:33 user nova-compute[74658]: No targets found.
Nov 16 15:39:33 user nova-compute[74658]: STATIC:
Nov 16 15:39:33 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580
Nov 16 15:39:33 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:39:33 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:39:33 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014
Nov 16 15:39:33 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:39:33 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:39:33 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b
Nov 16 15:39:33 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:39:33 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:39:33 user nova-compute[74658]: FIRMWARE:
Nov 16 15:39:33 user nova-compute[74658]: No targets found.
Nov 16 15:39:33 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:39:33 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:39:33 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cd0d15-bafb-4142-8a3c-f03cf3b70d65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[924c275b-add7-4967-939b-a589d705747d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:39:33 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:39:33 user nova-compute[74658]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 (non-flash)
Nov 16 15:39:33 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:39:33 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:39:33 user nova-compute[74658]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 (non-flash)
Nov 16 15:39:33 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710140430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[53626848-5cea-4d30-a10e-2ff9e1fd0b4e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0497b7cd-57af-400d-a434-339db8b3e730]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4266667a-4485-40e9-936a-ac9968f408e2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa9e993-fc21-47b3-8006-f07b4e595ce6]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2268bf6f-42d4-48c6-a4b3-979822c47952]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95a3586-a5a4-46a9-a651-d98a3c7d1268]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580, portal: 172.16.0.220,3260]
Nov 16 15:39:33 user nova-compute[74658]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580, portal: 172.16.0.220,3260] successful.
Nov 16 15:39:33 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b37465-3961-42d2-9344-fda36d69e580 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:34 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5277ae3-1755-49ef-a41c-fd64b77feb81]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:34 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:34 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:39:34 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] <== disconnect_volume: return (354ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:39:34 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:39:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:34 user nova-compute[74658]: DEBUG nova.objects.instance [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lazy-loading 'flavor' on Instance uuid 68cbf793-b573-44fd-97e2-e43f22c86b45 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:39:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-09f8277c-fe8e-44b1-a5fc-09c712ef4aac tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.799s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:36 user nova-compute[74658]: INFO nova.compute.manager [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Unshelving
Nov 16 15:39:36 user nova-compute[74658]: INFO nova.virt.block_device [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Booting with volume 94e3c39f-0623-4ee0-bba3-2bed35edf0d6 at /dev/vda
Nov 16 15:39:36 user nova-compute[74658]: DEBUG os_brick.utils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1906974f-245f-4831-9427-f42fe69dac7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02a6321-2978-45d8-8c7e-afba0cde1d0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2149545-6e13-408b-aec5-189f01a0007b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6296c07a-7bfc-426b-93ce-ea87fe3e2a1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:39:36 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:39:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c11b358-b66d-47c7-83d4-4309e31128ca]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG os_brick.utils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:39:36 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating existing volume attachment record: f155c675-9c8d-4c07-8148-c75bb645f338 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:39:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:41 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lazy-loading 'pci_requests' on Instance uuid ad92b41d-2fe6-4e3d-877e-aebf361ddb14 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:39:41 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lazy-loading 'numa_topology' on Instance uuid ad92b41d-2fe6-4e3d-877e-aebf361ddb14 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:39:41 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:39:41 user nova-compute[74658]: INFO nova.compute.claims [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Claim successful on node user
Nov 16 15:39:42 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:39:42 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:39:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:42 user nova-compute[74658]: INFO nova.network.neutron [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating port ea57a3ae-37e3-4d66-8bf3-177f9303bf4f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquired lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.network.neutron [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-4223cf81-fe20-4d99-a086-1b03a0003f04 req-79af9122-d84d-4494-92e7-61eba06bb02b service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-changed-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.compute.manager [req-4223cf81-fe20-4d99-a086-1b03a0003f04 req-79af9122-d84d-4494-92e7-61eba06bb02b service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Refreshing instance network info cache due to event network-changed-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4223cf81-fe20-4d99-a086-1b03a0003f04 req-79af9122-d84d-4494-92e7-61eba06bb02b service nova] Acquiring lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.network.neutron [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating instance_info_cache with network_info: [{"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Releasing lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:39:43 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Creating image(s)
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Did not create local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Ensure instance console log exists: /opt/stack/data/nova/instances/ad92b41d-2fe6-4e3d-877e-aebf361ddb14/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Start _get_guest_xml network_info=[{"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f155c675-9c8d-4c07-8148-c75bb645f338', 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZujWacb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad92b41d-2fe6-4e3d-877e-aebf361ddb14', 'attached_at': '', 'detached_at': '', 'volume_id': '94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 'serial': '94e3c39f-0623-4ee0-bba3-2bed35edf0d6'}, 'boot_index': 0, 'volume_type': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4223cf81-fe20-4d99-a086-1b03a0003f04 req-79af9122-d84d-4494-92e7-61eba06bb02b service nova] Acquired lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.network.neutron [req-4223cf81-fe20-4d99-a086-1b03a0003f04 req-79af9122-d84d-4494-92e7-61eba06bb02b service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Refreshing network info cache for port ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:39:43 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:39:43 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lazy-loading 'vcpu_model' on Instance uuid ad92b41d-2fe6-4e3d-877e-aebf361ddb14 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:39:43 user nova-compute[74658]: DEBUG nova.objects.base [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Object Instance<ad92b41d-2fe6-4e3d-877e-aebf361ddb14> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZujWacb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:39:44 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:39:44 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:39:44 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[589cad14-e5ba-493d-bf57-297e1959d130]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:39:44 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daf8eeb-6477-4814-bde8-7857da91aee6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6] added
Nov 16 15:39:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b094542a-e7ee-4a00-9476-ff2ec8e20c56]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7af46f1-e2c7-4896-861f-4bf5df14dd64]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZujWacb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZujWacb" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[03288290-0a5b-4738-b02e-360f5488c0fa]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EZujWacb'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebacb2d-ae53-4cda-bb77-7fa30d4d7010]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9d2f68-e632-4580-9780-79c5d222a84a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:39:44 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:39:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:39:44 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:39:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc5972b-6bf9-48da-863f-60547036bd6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260]
Nov 16 15:39:44 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260] successful.
Nov 16 15:39:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01b478b-28cd-42ff-a655-d41aef2219cd]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ce4ec8-31b8-4035-9b07-0f42c72b36f7]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:39:44 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:39:44 user nova-compute[74658]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:39:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:39:44 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:39:44 user nova-compute[74658]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:39:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7142691-f067-4163-aaf0-223d06fabd50]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZujWacb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG nova.network.neutron [req-4223cf81-fe20-4d99-a086-1b03a0003f04 req-79af9122-d84d-4494-92e7-61eba06bb02b service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updated VIF entry in instance network info cache for port ea57a3ae-37e3-4d66-8bf3-177f9303bf4f. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG nova.network.neutron [req-4223cf81-fe20-4d99-a086-1b03a0003f04 req-79af9122-d84d-4494-92e7-61eba06bb02b service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating instance_info_cache with network_info: [{"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4223cf81-fe20-4d99-a086-1b03a0003f04 req-79af9122-d84d-4494-92e7-61eba06bb02b service nova] Releasing lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:39:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23235303863626533', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235303863626533', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1301805927',display_name='tempest-TestShelveInstance-server-1301805927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1301805927',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1228229818',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:36:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='61ceda4e12ea4af5bdcb9f93cae4f24c',ramdisk_id='',reservation_id='r-gsvqsadq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-182953903',owner_user_name='tempest-TestShelveInstance-182953903-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:39:37Z,user_data=None,user_id='1f6f0cd0dea04b80a446774baf70b89e',uuid=ad92b41d-2fe6-4e3d-877e-aebf361ddb14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converting VIF {"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lazy-loading 'pci_devices' on Instance uuid ad92b41d-2fe6-4e3d-877e-aebf361ddb14 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.objects.base [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Object Instance<ad92b41d-2fe6-4e3d-877e-aebf361ddb14> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:39:45 user nova-compute[74658]:   <uuid>ad92b41d-2fe6-4e3d-877e-aebf361ddb14</uuid>
Nov 16 15:39:45 user nova-compute[74658]:   <name>instance-00000025</name>
Nov 16 15:39:45 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:39:45 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:39:45 user nova-compute[74658]:   <metadata>
Nov 16 15:39:45 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:39:45 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:39:45 user nova-compute[74658]:       <nova:name>tempest-TestShelveInstance-server-1301805927</nova:name>
Nov 16 15:39:45 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:39:43</nova:creationTime>
Nov 16 15:39:45 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:39:45 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:39:45 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:39:45 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:39:45 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:39:45 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:39:45 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:39:45 user nova-compute[74658]:       <nova:owner>
Nov 16 15:39:45 user nova-compute[74658]:         <nova:user uuid="1f6f0cd0dea04b80a446774baf70b89e">tempest-TestShelveInstance-182953903-project-member</nova:user>
Nov 16 15:39:45 user nova-compute[74658]:         <nova:project uuid="61ceda4e12ea4af5bdcb9f93cae4f24c">tempest-TestShelveInstance-182953903</nova:project>
Nov 16 15:39:45 user nova-compute[74658]:       </nova:owner>
Nov 16 15:39:45 user nova-compute[74658]:       <nova:ports>
Nov 16 15:39:45 user nova-compute[74658]:         <nova:port uuid="ea57a3ae-37e3-4d66-8bf3-177f9303bf4f">
Nov 16 15:39:45 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 15:39:45 user nova-compute[74658]:         </nova:port>
Nov 16 15:39:45 user nova-compute[74658]:       </nova:ports>
Nov 16 15:39:45 user nova-compute[74658]:     </nova:instance>
Nov 16 15:39:45 user nova-compute[74658]:   </metadata>
Nov 16 15:39:45 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:39:45 user nova-compute[74658]:     <system>
Nov 16 15:39:45 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:39:45 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:39:45 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:39:45 user nova-compute[74658]:       <entry name="serial">ad92b41d-2fe6-4e3d-877e-aebf361ddb14</entry>
Nov 16 15:39:45 user nova-compute[74658]:       <entry name="uuid">ad92b41d-2fe6-4e3d-877e-aebf361ddb14</entry>
Nov 16 15:39:45 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:39:45 user nova-compute[74658]:     </system>
Nov 16 15:39:45 user nova-compute[74658]:   </sysinfo>
Nov 16 15:39:45 user nova-compute[74658]:   <os>
Nov 16 15:39:45 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:39:45 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:39:45 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:39:45 user nova-compute[74658]:   </os>
Nov 16 15:39:45 user nova-compute[74658]:   <features>
Nov 16 15:39:45 user nova-compute[74658]:     <acpi/>
Nov 16 15:39:45 user nova-compute[74658]:     <apic/>
Nov 16 15:39:45 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:39:45 user nova-compute[74658]:   </features>
Nov 16 15:39:45 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:39:45 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:39:45 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:39:45 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:39:45 user nova-compute[74658]:   </clock>
Nov 16 15:39:45 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:39:45 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:39:45 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:39:45 user nova-compute[74658]:   </cpu>
Nov 16 15:39:45 user nova-compute[74658]:   <devices>
Nov 16 15:39:45 user nova-compute[74658]:     <disk type="block" device="disk">
Nov 16 15:39:45 user nova-compute[74658]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:39:45 user nova-compute[74658]:       <source dev="/dev/sdb"/>
Nov 16 15:39:45 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:39:45 user nova-compute[74658]:       <serial>94e3c39f-0623-4ee0-bba3-2bed35edf0d6</serial>
Nov 16 15:39:45 user nova-compute[74658]:     </disk>
Nov 16 15:39:45 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:39:45 user nova-compute[74658]:       <mac address="fa:16:3e:da:f7:24"/>
Nov 16 15:39:45 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:39:45 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:39:45 user nova-compute[74658]:       <target dev="tapea57a3ae-37"/>
Nov 16 15:39:45 user nova-compute[74658]:     </interface>
Nov 16 15:39:45 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:39:45 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/ad92b41d-2fe6-4e3d-877e-aebf361ddb14/console.log" append="off"/>
Nov 16 15:39:45 user nova-compute[74658]:     </serial>
Nov 16 15:39:45 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:39:45 user nova-compute[74658]:     <video>
Nov 16 15:39:45 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:39:45 user nova-compute[74658]:     </video>
Nov 16 15:39:45 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:39:45 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:39:45 user nova-compute[74658]:     </rng>
Nov 16 15:39:45 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:39:45 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:39:45 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:39:45 user nova-compute[74658]:     </memballoon>
Nov 16 15:39:45 user nova-compute[74658]:   </devices>
Nov 16 15:39:45 user nova-compute[74658]: </domain>
Nov 16 15:39:45 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1301805927',display_name='tempest-TestShelveInstance-server-1301805927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1301805927',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1228229818',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:36:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='61ceda4e12ea4af5bdcb9f93cae4f24c',ramdisk_id='',reservation_id='r-gsvqsadq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-182953903',owner_user_name='tempest-TestShelveInstance-182953903-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:39:37Z,user_data=None,user_id='1f6f0cd0dea04b80a446774baf70b89e',uuid=ad92b41d-2fe6-4e3d-877e-aebf361ddb14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converting VIF {"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG os_vif [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28540692-2c11-59a5-aa7f-ea53e606a022', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea57a3ae-37, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea57a3ae-37, col_values=(('qos', UUID('4c9f63a3-91aa-4f34-9910-9abf7a7ea7d4')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea57a3ae-37, col_values=(('external_ids', {'iface-id': 'ea57a3ae-37e3-4d66-8bf3-177f9303bf4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:f7:24', 'vm-uuid': 'ad92b41d-2fe6-4e3d-877e-aebf361ddb14'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:45 user nova-compute[74658]: INFO os_vif [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37')
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:39:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] No VIF found with MAC fa:16:3e:da:f7:24, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:39:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-bffe0a89-25c8-4fb0-99ac-90e65328abe3 req-3a9235a5-e144-4845-9d09-9902c1ec7cfc service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:39:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bffe0a89-25c8-4fb0-99ac-90e65328abe3 req-3a9235a5-e144-4845-9d09-9902c1ec7cfc service nova] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bffe0a89-25c8-4fb0-99ac-90e65328abe3 req-3a9235a5-e144-4845-9d09-9902c1ec7cfc service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bffe0a89-25c8-4fb0-99ac-90e65328abe3 req-3a9235a5-e144-4845-9d09-9902c1ec7cfc service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-bffe0a89-25c8-4fb0-99ac-90e65328abe3 req-3a9235a5-e144-4845-9d09-9902c1ec7cfc service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] No waiting events found dispatching network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:39:46 user nova-compute[74658]: WARNING nova.compute.manager [req-bffe0a89-25c8-4fb0-99ac-90e65328abe3 req-3a9235a5-e144-4845-9d09-9902c1ec7cfc service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received unexpected event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 15:39:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:39:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:39:48 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Instance spawned successfully.
Nov 16 15:39:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:39:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ae061d9c-8b36-4805-add9-11a979b3c357 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.307s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-67aa39ad-4e2f-4d6e-b47c-c2eceb4f5ea7 req-7c4a9bac-72b0-40ef-bfa3-26e3955da49d service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:39:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-67aa39ad-4e2f-4d6e-b47c-c2eceb4f5ea7 req-7c4a9bac-72b0-40ef-bfa3-26e3955da49d service nova] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-67aa39ad-4e2f-4d6e-b47c-c2eceb4f5ea7 req-7c4a9bac-72b0-40ef-bfa3-26e3955da49d service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-67aa39ad-4e2f-4d6e-b47c-c2eceb4f5ea7 req-7c4a9bac-72b0-40ef-bfa3-26e3955da49d service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-67aa39ad-4e2f-4d6e-b47c-c2eceb4f5ea7 req-7c4a9bac-72b0-40ef-bfa3-26e3955da49d service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] No waiting events found dispatching network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:39:48 user nova-compute[74658]: WARNING nova.compute.manager [req-67aa39ad-4e2f-4d6e-b47c-c2eceb4f5ea7 req-7c4a9bac-72b0-40ef-bfa3-26e3955da49d service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received unexpected event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f for instance with vm_state active and task_state None.
Nov 16 15:39:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:51 user nova-compute[74658]: INFO nova.compute.manager [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Terminating instance
Nov 16 15:39:51 user nova-compute[74658]: DEBUG nova.compute.manager [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:39:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-80dd3d95-c335-461e-9e5c-2ed09a7475d1 req-5b0d6b06-526b-4a39-a9bd-38ec3044f758 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-vif-unplugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-80dd3d95-c335-461e-9e5c-2ed09a7475d1 req-5b0d6b06-526b-4a39-a9bd-38ec3044f758 service nova] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-80dd3d95-c335-461e-9e5c-2ed09a7475d1 req-5b0d6b06-526b-4a39-a9bd-38ec3044f758 service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-80dd3d95-c335-461e-9e5c-2ed09a7475d1 req-5b0d6b06-526b-4a39-a9bd-38ec3044f758 service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-80dd3d95-c335-461e-9e5c-2ed09a7475d1 req-5b0d6b06-526b-4a39-a9bd-38ec3044f758 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] No waiting events found dispatching network-vif-unplugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-80dd3d95-c335-461e-9e5c-2ed09a7475d1 req-5b0d6b06-526b-4a39-a9bd-38ec3044f758 service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-vif-unplugged-5c27e2c4-4109-4450-ab40-70fbd6056674 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:39:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Instance destroyed successfully.
Nov 16 15:39:52 user nova-compute[74658]: DEBUG nova.objects.instance [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lazy-loading 'resources' on Instance uuid 396c5838-c4aa-4b02-9b9a-4f3296d85f2f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819937516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819937516',id=35,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfL30sylCzE4s7OaXUClxC/TLYSq+AkJw/cWYRvMCdN4KQS+9zm2S6f+A44zBkMEc4KoIAqpRUwHpjOnbCAuCPYrfLP0yUjLu5Mku/PeEcuRZ25l/ImXz70q859U/8ahQ==',key_name='tempest-keypair-1533894978',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e355315b27543ccacf00b9461cff1a0',ramdisk_id='',reservation_id='r-vav0s65l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1521088540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1521088540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e64660311e44e8aec0701ea52c2bb6',uuid=396c5838-c4aa-4b02-9b9a-4f3296d85f2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converting VIF {"id": "5c27e2c4-4109-4450-ab40-70fbd6056674", "address": "fa:16:3e:29:5e:37", "network": {"id": "dbf242c1-cf10-4558-9382-120adf576e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-698969898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e355315b27543ccacf00b9461cff1a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c27e2c4-41", "ovs_interfaceid": "5c27e2c4-4109-4450-ab40-70fbd6056674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG os_vif [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c27e2c4-41, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6942ab3b-2f5e-40ab-8d55-6f6937e1ce6c) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:52 user nova-compute[74658]: INFO os_vif [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:5e:37,bridge_name='br-int',has_traffic_filtering=True,id=5c27e2c4-4109-4450-ab40-70fbd6056674,network=Network(dbf242c1-cf10-4558-9382-120adf576e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c27e2c4-41')
Nov 16 15:39:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Deleting instance files /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f_del
Nov 16 15:39:52 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Deletion of /opt/stack/data/nova/instances/396c5838-c4aa-4b02-9b9a-4f3296d85f2f_del complete
Nov 16 15:39:52 user nova-compute[74658]: INFO nova.compute.manager [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 16 15:39:52 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:39:52 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:39:53 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:39:53 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Took 0.85 seconds to deallocate network for instance.
Nov 16 15:39:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:53 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:39:53 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:39:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:53 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Deleted allocations for instance 396c5838-c4aa-4b02-9b9a-4f3296d85f2f
Nov 16 15:39:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-274d493d-ab3b-4186-825e-08af03b0f41e tempest-AttachVolumeShelveTestJSON-1521088540 tempest-AttachVolumeShelveTestJSON-1521088540-project-member] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.019s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-0f98743c-7e7a-435c-aa5a-2f8a9bd5cec5 req-e8786e05-62d4-4f59-bdf0-a99970965ace service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:39:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f98743c-7e7a-435c-aa5a-2f8a9bd5cec5 req-e8786e05-62d4-4f59-bdf0-a99970965ace service nova] Acquiring lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:39:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f98743c-7e7a-435c-aa5a-2f8a9bd5cec5 req-e8786e05-62d4-4f59-bdf0-a99970965ace service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:39:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f98743c-7e7a-435c-aa5a-2f8a9bd5cec5 req-e8786e05-62d4-4f59-bdf0-a99970965ace service nova] Lock "396c5838-c4aa-4b02-9b9a-4f3296d85f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:39:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-0f98743c-7e7a-435c-aa5a-2f8a9bd5cec5 req-e8786e05-62d4-4f59-bdf0-a99970965ace service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] No waiting events found dispatching network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:39:54 user nova-compute[74658]: WARNING nova.compute.manager [req-0f98743c-7e7a-435c-aa5a-2f8a9bd5cec5 req-e8786e05-62d4-4f59-bdf0-a99970965ace service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received unexpected event network-vif-plugged-5c27e2c4-4109-4450-ab40-70fbd6056674 for instance with vm_state deleted and task_state None.
Nov 16 15:39:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-0f98743c-7e7a-435c-aa5a-2f8a9bd5cec5 req-e8786e05-62d4-4f59-bdf0-a99970965ace service nova] [instance: 396c5838-c4aa-4b02-9b9a-4f3296d85f2f] Received event network-vif-deleted-5c27e2c4-4109-4450-ab40-70fbd6056674 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:39:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:39:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "68cbf793-b573-44fd-97e2-e43f22c86b45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:05 user nova-compute[74658]: INFO nova.compute.manager [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Terminating instance
Nov 16 15:40:05 user nova-compute[74658]: DEBUG nova.compute.manager [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:40:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-5d5c6be3-2911-49a8-b825-ad461b96bbdc req-43a078cc-f3e0-47ef-a154-c5ddd6c46b9b service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Received event network-vif-unplugged-9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5d5c6be3-2911-49a8-b825-ad461b96bbdc req-43a078cc-f3e0-47ef-a154-c5ddd6c46b9b service nova] Acquiring lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5d5c6be3-2911-49a8-b825-ad461b96bbdc req-43a078cc-f3e0-47ef-a154-c5ddd6c46b9b service nova] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5d5c6be3-2911-49a8-b825-ad461b96bbdc req-43a078cc-f3e0-47ef-a154-c5ddd6c46b9b service nova] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-5d5c6be3-2911-49a8-b825-ad461b96bbdc req-43a078cc-f3e0-47ef-a154-c5ddd6c46b9b service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] No waiting events found dispatching network-vif-unplugged-9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-5d5c6be3-2911-49a8-b825-ad461b96bbdc req-43a078cc-f3e0-47ef-a154-c5ddd6c46b9b service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Received event network-vif-unplugged-9461bfd8-5aea-45ee-9241-b95b771cf460 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:40:06 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Instance destroyed successfully.
Nov 16 15:40:06 user nova-compute[74658]: DEBUG nova.objects.instance [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lazy-loading 'resources' on Instance uuid 68cbf793-b573-44fd-97e2-e43f22c86b45 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:37:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125171517',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125171517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2125171',id=41,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxreju2YX3deN4Zm8dK99o/9eHIP5tQwIbSBmoURStHh7sTSWn4yshGnaOqSz5XfO5rbwqf6/MzASUX4woAZZHW21BQg12aCd0Ai5IHpKXBub+Ne3RmhVR6M1m+t5iQag==',key_name='tempest-keypair-706080034',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:37:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2be0dc9ded2d4a638a2f17c7c2a6c1c2',ramdisk_id='',reservation_id='r-46o19zc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2092989913',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c9d25b034454cb08cd29e785af6bed6',uuid=68cbf793-b573-44fd-97e2-e43f22c86b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9461bfd8-5aea-45ee-9241-b95b771cf460", "address": "fa:16:3e:05:74:46", "network": {"id": "b97deb7d-4ac9-46a0-b8bb-c65ef92e892b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-692810974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2be0dc9ded2d4a638a2f17c7c2a6c1c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9461bfd8-5a", "ovs_interfaceid": "9461bfd8-5aea-45ee-9241-b95b771cf460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Converting VIF {"id": "9461bfd8-5aea-45ee-9241-b95b771cf460", "address": "fa:16:3e:05:74:46", "network": {"id": "b97deb7d-4ac9-46a0-b8bb-c65ef92e892b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-692810974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2be0dc9ded2d4a638a2f17c7c2a6c1c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9461bfd8-5a", "ovs_interfaceid": "9461bfd8-5aea-45ee-9241-b95b771cf460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:74:46,bridge_name='br-int',has_traffic_filtering=True,id=9461bfd8-5aea-45ee-9241-b95b771cf460,network=Network(b97deb7d-4ac9-46a0-b8bb-c65ef92e892b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9461bfd8-5a') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG os_vif [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:74:46,bridge_name='br-int',has_traffic_filtering=True,id=9461bfd8-5aea-45ee-9241-b95b771cf460,network=Network(b97deb7d-4ac9-46a0-b8bb-c65ef92e892b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9461bfd8-5a') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9461bfd8-5a, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86e35295-0eec-417f-9cb6-9241ce73f1aa) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:06 user nova-compute[74658]: INFO os_vif [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:74:46,bridge_name='br-int',has_traffic_filtering=True,id=9461bfd8-5aea-45ee-9241-b95b771cf460,network=Network(b97deb7d-4ac9-46a0-b8bb-c65ef92e892b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9461bfd8-5a')
Nov 16 15:40:06 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Deleting instance files /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45_del
Nov 16 15:40:06 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Deletion of /opt/stack/data/nova/instances/68cbf793-b573-44fd-97e2-e43f22c86b45_del complete
Nov 16 15:40:06 user nova-compute[74658]: INFO nova.compute.manager [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 15:40:06 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:40:06 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:40:07 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:40:07 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Took 0.77 seconds to deallocate network for instance.
Nov 16 15:40:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:07 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:40:07 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:40:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:07 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Deleted allocations for instance 68cbf793-b573-44fd-97e2-e43f22c86b45
Nov 16 15:40:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-683fb819-02f6-4b4a-9c30-9aaed9b38fc3 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913 tempest-TestServerVolumeAttachScenarioOldVersion-2092989913-project-member] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.085s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-a63eba0d-89d4-4640-8419-41b1e450913a req-db05c7ce-3812-4937-b9cf-bcc14f215bd4 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Received event network-vif-plugged-9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:40:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a63eba0d-89d4-4640-8419-41b1e450913a req-db05c7ce-3812-4937-b9cf-bcc14f215bd4 service nova] Acquiring lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a63eba0d-89d4-4640-8419-41b1e450913a req-db05c7ce-3812-4937-b9cf-bcc14f215bd4 service nova] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a63eba0d-89d4-4640-8419-41b1e450913a req-db05c7ce-3812-4937-b9cf-bcc14f215bd4 service nova] Lock "68cbf793-b573-44fd-97e2-e43f22c86b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-a63eba0d-89d4-4640-8419-41b1e450913a req-db05c7ce-3812-4937-b9cf-bcc14f215bd4 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] No waiting events found dispatching network-vif-plugged-9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:40:08 user nova-compute[74658]: WARNING nova.compute.manager [req-a63eba0d-89d4-4640-8419-41b1e450913a req-db05c7ce-3812-4937-b9cf-bcc14f215bd4 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Received unexpected event network-vif-plugged-9461bfd8-5aea-45ee-9241-b95b771cf460 for instance with vm_state deleted and task_state None.
Nov 16 15:40:08 user nova-compute[74658]: DEBUG nova.compute.manager [req-a63eba0d-89d4-4640-8419-41b1e450913a req-db05c7ce-3812-4937-b9cf-bcc14f215bd4 service nova] [instance: 68cbf793-b573-44fd-97e2-e43f22c86b45] Received event network-vif-deleted-9461bfd8-5aea-45ee-9241-b95b771cf460 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:40:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:40:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-1c9ea2ca-fe25-4ae8-8c39-2e408544d617 req-1415296a-52c5-413d-8228-28f1aaba2f81 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received event network-changed-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:40:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-1c9ea2ca-fe25-4ae8-8c39-2e408544d617 req-1415296a-52c5-413d-8228-28f1aaba2f81 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Refreshing instance network info cache due to event network-changed-6d4d062f-b33e-49c6-8e7e-9869f7439989. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:40:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1c9ea2ca-fe25-4ae8-8c39-2e408544d617 req-1415296a-52c5-413d-8228-28f1aaba2f81 service nova] Acquiring lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:40:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1c9ea2ca-fe25-4ae8-8c39-2e408544d617 req-1415296a-52c5-413d-8228-28f1aaba2f81 service nova] Acquired lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:40:10 user nova-compute[74658]: DEBUG nova.network.neutron [req-1c9ea2ca-fe25-4ae8-8c39-2e408544d617 req-1415296a-52c5-413d-8228-28f1aaba2f81 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Refreshing network info cache for port 6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:40:11 user nova-compute[74658]: DEBUG nova.network.neutron [req-1c9ea2ca-fe25-4ae8-8c39-2e408544d617 req-1415296a-52c5-413d-8228-28f1aaba2f81 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Updated VIF entry in instance network info cache for port 6d4d062f-b33e-49c6-8e7e-9869f7439989. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:40:11 user nova-compute[74658]: DEBUG nova.network.neutron [req-1c9ea2ca-fe25-4ae8-8c39-2e408544d617 req-1415296a-52c5-413d-8228-28f1aaba2f81 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Updating instance_info_cache with network_info: [{"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:40:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1c9ea2ca-fe25-4ae8-8c39-2e408544d617 req-1415296a-52c5-413d-8228-28f1aaba2f81 service nova] Releasing lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:40:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:11 user nova-compute[74658]: INFO nova.compute.manager [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Terminating instance
Nov 16 15:40:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:40:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:40:12 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Instance destroyed successfully.
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.objects.instance [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'resources' on Instance uuid 534868c0-fdd2-4f54-b4e8-db28ccaa967f {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1180337277',display_name='tempest-TestVolumeBootPattern-server-1180337277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1180337277',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa3gqCorV1WbIg5i//0wnlopR+3KlyeNwvcR7SHxTAoz1md6ZPUq6Nr5c+6nYZB4Ns6g0kjBKvILHRe+adcrSzLJ8v98clK+l5Pw4QpWw7oSlS+Kt7nCSty+cuvnOaubg==',key_name='tempest-TestVolumeBootPattern-1945158636',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-9btrh0ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:38:31Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=534868c0-fdd2-4f54-b4e8-db28ccaa967f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:5c:ff,bridge_name='br-int',has_traffic_filtering=True,id=6d4d062f-b33e-49c6-8e7e-9869f7439989,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4d062f-b3') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_vif [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:5c:ff,bridge_name='br-int',has_traffic_filtering=True,id=6d4d062f-b33e-49c6-8e7e-9869f7439989,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4d062f-b3') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d4d062f-b3, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5b9449c-23e4-409f-8afc-b4ada35f4126) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:12 user nova-compute[74658]: INFO os_vif [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:5c:ff,bridge_name='br-int',has_traffic_filtering=True,id=6d4d062f-b33e-49c6-8e7e-9869f7439989,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4d062f-b3')
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjtZGDLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:40:12 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a2a43-b09b-4ca0-9351-c41ea116ca7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:40:12 user nova-compute[74658]: No targets found.
Nov 16 15:40:12 user nova-compute[74658]: iSNS:
Nov 16 15:40:12 user nova-compute[74658]: No targets found.
Nov 16 15:40:12 user nova-compute[74658]: STATIC:
Nov 16 15:40:12 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014
Nov 16 15:40:12 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:40:12 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:40:12 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b
Nov 16 15:40:12 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:40:12 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:40:12 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6
Nov 16 15:40:12 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:40:12 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:40:12 user nova-compute[74658]: FIRMWARE:
Nov 16 15:40:12 user nova-compute[74658]: No targets found.
Nov 16 15:40:12 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:40:12 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:40:12 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22b3b08-a32d-46aa-b14a-bbe27de53600]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2bd5e4-4621-43f3-99f4-2a033ec0363d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:40:12 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:40:12 user nova-compute[74658]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:40:12 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:40:12 user nova-compute[74658]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b (non-flash)
Nov 16 15:40:12 user nova-compute[74658]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:40:12 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0730462710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b'): ({'sdd'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Removing single pathed devices sdd {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb896a11-92e6-4cd4-9a97-d860492ba489]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc3f07f-bca6-43b2-b7cd-5c281905f873]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flushing IO for device /dev/sdd {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3142b5-77e2-4ae0-9a30-90a421421d42]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updating instance_info_cache with network_info: [{"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc10b34b-f34d-43d0-8b85-05476fc565c2]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] SCSI volumes sdd have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8add5312-74407158b910eba4',) {{(pid=84815) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 15:40:12 user nova-compute[74658]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO8add5312-74407158b910eba4
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8806b28d-351a-4a30-a42e-d46fc4fdeaf8]: (4, None) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e02de73-bc89-4b00-a7a3-034fefdabe1e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7456ef45-47b2-442c-912d-568ebda50bdf]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b, portal: 172.16.0.220,3260]
Nov 16 15:40:12 user nova-compute[74658]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b, portal: 172.16.0.220,3260] successful.
Nov 16 15:40:12 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f763db24-ebb0-402c-8c3a-e54a8422ad5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d719cc-b83f-4261-9ad5-f86fa527a6d4]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== disconnect_volume: return (311ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:40:12 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Deleting instance files /opt/stack/data/nova/instances/534868c0-fdd2-4f54-b4e8-db28ccaa967f_del
Nov 16 15:40:12 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Deletion of /opt/stack/data/nova/instances/534868c0-fdd2-4f54-b4e8-db28ccaa967f_del complete
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received event network-changed-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Refreshing instance network info cache due to event network-changed-6d4d062f-b33e-49c6-8e7e-9869f7439989. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] Acquiring lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] Acquired lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.network.neutron [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Refreshing network info cache for port 6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:40:12 user nova-compute[74658]: INFO nova.compute.manager [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 16 15:40:12 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:40:12 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Updated VIF entry in instance network info cache for port 6d4d062f-b33e-49c6-8e7e-9869f7439989. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Updating instance_info_cache with network_info: [{"id": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "address": "fa:16:3e:55:5c:ff", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4d062f-b3", "ovs_interfaceid": "6d4d062f-b33e-49c6-8e7e-9869f7439989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] Releasing lock "refresh_cache-534868c0-fdd2-4f54-b4e8-db28ccaa967f" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received event network-vif-unplugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] Acquiring lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] No waiting events found dispatching network-vif-unplugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received event network-vif-unplugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received event network-vif-plugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] Acquiring lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] No waiting events found dispatching network-vif-plugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:40:13 user nova-compute[74658]: WARNING nova.compute.manager [req-ec4ac7b4-8433-4b2d-a7bd-801e4493230f req-3a4f00d0-3bca-423d-88d6-470ba7839fe7 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received unexpected event network-vif-plugged-6d4d062f-b33e-49c6-8e7e-9869f7439989 for instance with vm_state active and task_state deleting.
Nov 16 15:40:13 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:40:13 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Took 0.47 seconds to deallocate network for instance.
Nov 16 15:40:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-441ed188-56b2-41fd-a9fa-16a88f7d17e7 req-36a55de2-4ed5-40d6-8fa7-48f573277704 service nova] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Received event network-vif-deleted-6d4d062f-b33e-49c6-8e7e-9869f7439989 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:40:14 user nova-compute[74658]: INFO nova.compute.manager [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 534868c0-fdd2-4f54-b4e8-db28ccaa967f] Took 0.75 seconds to detach 1 volumes for instance.
Nov 16 15:40:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:14 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:40:14 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:40:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:14 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Deleted allocations for instance 534868c0-fdd2-4f54-b4e8-db28ccaa967f
Nov 16 15:40:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a5d9d872-0572-4f9f-ab54-e1c56c7dd2a9 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "534868c0-fdd2-4f54-b4e8-db28ccaa967f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.795s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:15 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:40:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:17 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:40:17 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:40:17 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8399MB free_disk=25.339832305908203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 459a4296-6338-49d3-a3ba-f881418f9d7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ad92b41d-2fe6-4e3d-877e-aebf361ddb14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:40:17 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:40:18 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:40:18 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:40:18 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:40:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:40:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:40:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:40:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:21 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:40:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:40:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:40:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:40:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-2468ace7-6f1a-4fac-8aff-e97ec104f402 req-301f7476-2ddc-43c4-b4ce-9f52e5129047 service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received event network-changed-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-2468ace7-6f1a-4fac-8aff-e97ec104f402 req-301f7476-2ddc-43c4-b4ce-9f52e5129047 service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Refreshing instance network info cache due to event network-changed-62eaa972-e599-49b6-8310-3872c69febdd. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2468ace7-6f1a-4fac-8aff-e97ec104f402 req-301f7476-2ddc-43c4-b4ce-9f52e5129047 service nova] Acquiring lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2468ace7-6f1a-4fac-8aff-e97ec104f402 req-301f7476-2ddc-43c4-b4ce-9f52e5129047 service nova] Acquired lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG nova.network.neutron [req-2468ace7-6f1a-4fac-8aff-e97ec104f402 req-301f7476-2ddc-43c4-b4ce-9f52e5129047 service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Refreshing network info cache for port 62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "459a4296-6338-49d3-a3ba-f881418f9d7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:07 user nova-compute[74658]: INFO nova.compute.manager [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Terminating instance
Nov 16 15:41:07 user nova-compute[74658]: DEBUG nova.compute.manager [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-400cabba-e582-424a-a260-aab1a2d8e477 req-bf399309-8cb7-4fb2-bc53-4bc602990cef service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received event network-vif-unplugged-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-400cabba-e582-424a-a260-aab1a2d8e477 req-bf399309-8cb7-4fb2-bc53-4bc602990cef service nova] Acquiring lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-400cabba-e582-424a-a260-aab1a2d8e477 req-bf399309-8cb7-4fb2-bc53-4bc602990cef service nova] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-400cabba-e582-424a-a260-aab1a2d8e477 req-bf399309-8cb7-4fb2-bc53-4bc602990cef service nova] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-400cabba-e582-424a-a260-aab1a2d8e477 req-bf399309-8cb7-4fb2-bc53-4bc602990cef service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] No waiting events found dispatching network-vif-unplugged-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG nova.compute.manager [req-400cabba-e582-424a-a260-aab1a2d8e477 req-bf399309-8cb7-4fb2-bc53-4bc602990cef service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received event network-vif-unplugged-62eaa972-e599-49b6-8310-3872c69febdd for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG nova.network.neutron [req-2468ace7-6f1a-4fac-8aff-e97ec104f402 req-301f7476-2ddc-43c4-b4ce-9f52e5129047 service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Updated VIF entry in instance network info cache for port 62eaa972-e599-49b6-8310-3872c69febdd. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG nova.network.neutron [req-2468ace7-6f1a-4fac-8aff-e97ec104f402 req-301f7476-2ddc-43c4-b4ce-9f52e5129047 service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Updating instance_info_cache with network_info: [{"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:41:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2468ace7-6f1a-4fac-8aff-e97ec104f402 req-301f7476-2ddc-43c4-b4ce-9f52e5129047 service nova] Releasing lock "refresh_cache-459a4296-6338-49d3-a3ba-f881418f9d7c" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:41:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Instance destroyed successfully.
Nov 16 15:41:08 user nova-compute[74658]: DEBUG nova.objects.instance [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lazy-loading 'resources' on Instance uuid 459a4296-6338-49d3-a3ba-f881418f9d7c {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-860938395',display_name='tempest-TestVolumeBootPattern-server-860938395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-860938395',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa3gqCorV1WbIg5i//0wnlopR+3KlyeNwvcR7SHxTAoz1md6ZPUq6Nr5c+6nYZB4Ns6g0kjBKvILHRe+adcrSzLJ8v98clK+l5Pw4QpWw7oSlS+Kt7nCSty+cuvnOaubg==',key_name='tempest-TestVolumeBootPattern-1945158636',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:36:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2156886e7c2247e38a1ffe4025798a96',ramdisk_id='',reservation_id='r-drzovq4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1853010836',owner_user_name='tempest-TestVolumeBootPattern-1853010836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:36:33Z,user_data=None,user_id='aed7ea9505b3400ebbe1ce456419bc82',uuid=459a4296-6338-49d3-a3ba-f881418f9d7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converting VIF {"id": "62eaa972-e599-49b6-8310-3872c69febdd", "address": "fa:16:3e:01:8b:e9", "network": {"id": "6dd7c626-d741-4484-bec0-0897798ff4ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1330287131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2156886e7c2247e38a1ffe4025798a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eaa972-e5", "ovs_interfaceid": "62eaa972-e599-49b6-8310-3872c69febdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=62eaa972-e599-49b6-8310-3872c69febdd,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eaa972-e5') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_vif [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=62eaa972-e599-49b6-8310-3872c69febdd,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eaa972-e5') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62eaa972-e5, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e01eb21-5d85-4dc0-8e00-4a9b96170132) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:41:08 user nova-compute[74658]: INFO os_vif [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=62eaa972-e599-49b6-8310-3872c69febdd,network=Network(6dd7c626-d741-4484-bec0-0897798ff4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eaa972-e5')
Nov 16 15:41:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJDPvkmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:41:08 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[190abdbf-2b8e-45dc-a48f-7b46049fa1c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:41:08 user nova-compute[74658]: No targets found.
Nov 16 15:41:08 user nova-compute[74658]: iSNS:
Nov 16 15:41:08 user nova-compute[74658]: No targets found.
Nov 16 15:41:08 user nova-compute[74658]: STATIC:
Nov 16 15:41:08 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014
Nov 16 15:41:08 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:41:08 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:41:08 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6
Nov 16 15:41:08 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:41:08 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:41:08 user nova-compute[74658]: FIRMWARE:
Nov 16 15:41:08 user nova-compute[74658]: No targets found.
Nov 16 15:41:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:41:08 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:41:08 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f694ef-f67a-46fb-86c2-8559e8f6bfa9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[20314c45-f28d-47b3-b89e-9f4316933eac]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:41:08 user nova-compute[74658]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:41:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 (non-flash)
Nov 16 15:41:08 user nova-compute[74658]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:41:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f071034fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[433e0ad1-ebf3-49b8-9a35-c874ee57626b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0741a924-5a71-4050-971a-cb5b9564e385]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86028d8-a963-4085-a7d8-1d6b39e63cfd]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.098s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8436c80-15f7-45b2-bc7c-a04ec02dad20]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e9a81eac', '/dev/disk/by-id/scsi-23238616332383661', '/dev/disk/by-id/scsi-1SCST_BIOe9a81eac-28ac286a2b3b3c0b') {{(pid=84815) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e778f8a1-6a99-40c9-a28d-f84fa995c4b6]: (4, None) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cf4450-d2e5-435c-8fc8-6d6c83f2b351]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f0577a-7994-4e61-b223-fd9de5023bd1]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260]
Nov 16 15:41:08 user nova-compute[74658]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014, portal: 172.16.0.220,3260] successful.
Nov 16 15:41:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35afd958-7ad4-4133-8bfa-bfccac228014 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[18937968-629f-4cc6-a0ab-7848af898afa]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] <== disconnect_volume: return (387ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:41:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Deleting instance files /opt/stack/data/nova/instances/459a4296-6338-49d3-a3ba-f881418f9d7c_del
Nov 16 15:41:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Deletion of /opt/stack/data/nova/instances/459a4296-6338-49d3-a3ba-f881418f9d7c_del complete
Nov 16 15:41:08 user nova-compute[74658]: INFO nova.compute.manager [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 16 15:41:08 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:41:08 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:41:09 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:41:09 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Took 0.88 seconds to deallocate network for instance.
Nov 16 15:41:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-785bfca2-c47c-40ce-8d58-66fa2c21ea46 req-ecd360e5-b545-4983-ae2a-4f00c4c490ca service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received event network-vif-deleted-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-0f82fcaa-f3c5-4797-9702-5b78f3ff84a1 req-36d059d0-8f72-4b3f-b635-ed4a01a89f2d service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received event network-vif-plugged-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f82fcaa-f3c5-4797-9702-5b78f3ff84a1 req-36d059d0-8f72-4b3f-b635-ed4a01a89f2d service nova] Acquiring lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f82fcaa-f3c5-4797-9702-5b78f3ff84a1 req-36d059d0-8f72-4b3f-b635-ed4a01a89f2d service nova] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f82fcaa-f3c5-4797-9702-5b78f3ff84a1 req-36d059d0-8f72-4b3f-b635-ed4a01a89f2d service nova] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:09 user nova-compute[74658]: DEBUG nova.compute.manager [req-0f82fcaa-f3c5-4797-9702-5b78f3ff84a1 req-36d059d0-8f72-4b3f-b635-ed4a01a89f2d service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] No waiting events found dispatching network-vif-plugged-62eaa972-e599-49b6-8310-3872c69febdd {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:09 user nova-compute[74658]: WARNING nova.compute.manager [req-0f82fcaa-f3c5-4797-9702-5b78f3ff84a1 req-36d059d0-8f72-4b3f-b635-ed4a01a89f2d service nova] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Received unexpected event network-vif-plugged-62eaa972-e599-49b6-8310-3872c69febdd for instance with vm_state active and task_state deleting.
Nov 16 15:41:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:41:10 user nova-compute[74658]: INFO nova.compute.manager [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] [instance: 459a4296-6338-49d3-a3ba-f881418f9d7c] Took 0.71 seconds to detach 1 volumes for instance.
Nov 16 15:41:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:10 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:41:10 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:41:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:10 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Deleted allocations for instance 459a4296-6338-49d3-a3ba-f881418f9d7c
Nov 16 15:41:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9918bfb0-37bc-46f3-88f1-e68c1bc7e3d1 tempest-TestVolumeBootPattern-1853010836 tempest-TestVolumeBootPattern-1853010836-project-member] Lock "459a4296-6338-49d3-a3ba-f881418f9d7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.236s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Acquiring lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:41:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:10 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:41:10 user nova-compute[74658]: INFO nova.compute.claims [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Claim successful on node user
Nov 16 15:41:11 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:41:11 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:41:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG nova.policy [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a06a787b31142a992e1741d13cb1702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e53549a27497a9c9db746adaccdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:41:11 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Creating image(s)
Nov 16 15:41:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "/opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "/opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:11 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk 1073741824" returned: 0 in 0.054s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Successfully created port: f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.199s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Cannot resize image /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Ensure instance console log exists: /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Successfully updated port: f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Acquiring lock "refresh_cache-0ec1e159-1e27-49ce-aa65-ad961d72ff90" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Acquired lock "refresh_cache-0ec1e159-1e27-49ce-aa65-ad961d72ff90" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-ad8452b7-2f6f-4d13-b892-7a8059f65d47 req-a4efbaee-1770-4cc1-88d0-69c9f1746531 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Received event network-changed-f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-ad8452b7-2f6f-4d13-b892-7a8059f65d47 req-a4efbaee-1770-4cc1-88d0-69c9f1746531 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Refreshing instance network info cache due to event network-changed-f9b96757-d00f-4d27-b912-7e59c192ad62. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ad8452b7-2f6f-4d13-b892-7a8059f65d47 req-a4efbaee-1770-4cc1-88d0-69c9f1746531 service nova] Acquiring lock "refresh_cache-0ec1e159-1e27-49ce-aa65-ad961d72ff90" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:41:12 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Updating instance_info_cache with network_info: [{"id": "f9b96757-d00f-4d27-b912-7e59c192ad62", "address": "fa:16:3e:21:dd:10", "network": {"id": "9afd2405-3dd5-4d89-b3d6-806503ac8a5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6485794c78ee4e53a265b2e22a843590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b96757-d0", "ovs_interfaceid": "f9b96757-d00f-4d27-b912-7e59c192ad62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Skipping network cache update for instance because it is Building. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Releasing lock "refresh_cache-0ec1e159-1e27-49ce-aa65-ad961d72ff90" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Instance network_info: |[{"id": "f9b96757-d00f-4d27-b912-7e59c192ad62", "address": "fa:16:3e:21:dd:10", "network": {"id": "9afd2405-3dd5-4d89-b3d6-806503ac8a5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6485794c78ee4e53a265b2e22a843590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b96757-d0", "ovs_interfaceid": "f9b96757-d00f-4d27-b912-7e59c192ad62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ad8452b7-2f6f-4d13-b892-7a8059f65d47 req-a4efbaee-1770-4cc1-88d0-69c9f1746531 service nova] Acquired lock "refresh_cache-0ec1e159-1e27-49ce-aa65-ad961d72ff90" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-ad8452b7-2f6f-4d13-b892-7a8059f65d47 req-a4efbaee-1770-4cc1-88d0-69c9f1746531 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Refreshing network info cache for port f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Start _get_guest_xml network_info=[{"id": "f9b96757-d00f-4d27-b912-7e59c192ad62", "address": "fa:16:3e:21:dd:10", "network": {"id": "9afd2405-3dd5-4d89-b3d6-806503ac8a5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6485794c78ee4e53a265b2e22a843590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b96757-d0", "ovs_interfaceid": "f9b96757-d00f-4d27-b912-7e59c192ad62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:41:13 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:41:13 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2071072744',display_name='tempest-VolumesNegativeTest-instance-2071072744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2071072744',id=43,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c53e53549a27497a9c9db746adaccdbd',ramdisk_id='',reservation_id='r-wf7y9w8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1877728517',owner_user_name='tempest-VolumesNegativeTest-1877728517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:41:12Z,user_data=None,user_id='5a06a787b31142a992e1741d13cb1702',uuid=0ec1e159-1e27-49ce-aa65-ad961d72ff90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9b96757-d00f-4d27-b912-7e59c192ad62", "address": "fa:16:3e:21:dd:10", "network": {"id": "9afd2405-3dd5-4d89-b3d6-806503ac8a5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6485794c78ee4e53a265b2e22a843590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b96757-d0", "ovs_interfaceid": "f9b96757-d00f-4d27-b912-7e59c192ad62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Converting VIF {"id": "f9b96757-d00f-4d27-b912-7e59c192ad62", "address": "fa:16:3e:21:dd:10", "network": {"id": "9afd2405-3dd5-4d89-b3d6-806503ac8a5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6485794c78ee4e53a265b2e22a843590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b96757-d0", "ovs_interfaceid": "f9b96757-d00f-4d27-b912-7e59c192ad62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:dd:10,bridge_name='br-int',has_traffic_filtering=True,id=f9b96757-d00f-4d27-b912-7e59c192ad62,network=Network(9afd2405-3dd5-4d89-b3d6-806503ac8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b96757-d0') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.objects.instance [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ec1e159-1e27-49ce-aa65-ad961d72ff90 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:41:13 user nova-compute[74658]:   <uuid>0ec1e159-1e27-49ce-aa65-ad961d72ff90</uuid>
Nov 16 15:41:13 user nova-compute[74658]:   <name>instance-0000002b</name>
Nov 16 15:41:13 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:41:13 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:41:13 user nova-compute[74658]:   <metadata>
Nov 16 15:41:13 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:41:13 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:41:13 user nova-compute[74658]:       <nova:name>tempest-VolumesNegativeTest-instance-2071072744</nova:name>
Nov 16 15:41:13 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:41:13</nova:creationTime>
Nov 16 15:41:13 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:41:13 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:41:13 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:41:13 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:41:13 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:41:13 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:41:13 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:41:13 user nova-compute[74658]:       <nova:owner>
Nov 16 15:41:13 user nova-compute[74658]:         <nova:user uuid="5a06a787b31142a992e1741d13cb1702">tempest-VolumesNegativeTest-1877728517-project-member</nova:user>
Nov 16 15:41:13 user nova-compute[74658]:         <nova:project uuid="c53e53549a27497a9c9db746adaccdbd">tempest-VolumesNegativeTest-1877728517</nova:project>
Nov 16 15:41:13 user nova-compute[74658]:       </nova:owner>
Nov 16 15:41:13 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:41:13 user nova-compute[74658]:       <nova:ports>
Nov 16 15:41:13 user nova-compute[74658]:         <nova:port uuid="f9b96757-d00f-4d27-b912-7e59c192ad62">
Nov 16 15:41:13 user nova-compute[74658]:           <nova:ip type="fixed" address="192.168.233.3" ipVersion="4"/>
Nov 16 15:41:13 user nova-compute[74658]:         </nova:port>
Nov 16 15:41:13 user nova-compute[74658]:       </nova:ports>
Nov 16 15:41:13 user nova-compute[74658]:     </nova:instance>
Nov 16 15:41:13 user nova-compute[74658]:   </metadata>
Nov 16 15:41:13 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:41:13 user nova-compute[74658]:     <system>
Nov 16 15:41:13 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:41:13 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:41:13 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:41:13 user nova-compute[74658]:       <entry name="serial">0ec1e159-1e27-49ce-aa65-ad961d72ff90</entry>
Nov 16 15:41:13 user nova-compute[74658]:       <entry name="uuid">0ec1e159-1e27-49ce-aa65-ad961d72ff90</entry>
Nov 16 15:41:13 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:41:13 user nova-compute[74658]:     </system>
Nov 16 15:41:13 user nova-compute[74658]:   </sysinfo>
Nov 16 15:41:13 user nova-compute[74658]:   <os>
Nov 16 15:41:13 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:41:13 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:41:13 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:41:13 user nova-compute[74658]:   </os>
Nov 16 15:41:13 user nova-compute[74658]:   <features>
Nov 16 15:41:13 user nova-compute[74658]:     <acpi/>
Nov 16 15:41:13 user nova-compute[74658]:     <apic/>
Nov 16 15:41:13 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:41:13 user nova-compute[74658]:   </features>
Nov 16 15:41:13 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:41:13 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:41:13 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:41:13 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:41:13 user nova-compute[74658]:   </clock>
Nov 16 15:41:13 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:41:13 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:41:13 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:41:13 user nova-compute[74658]:   </cpu>
Nov 16 15:41:13 user nova-compute[74658]:   <devices>
Nov 16 15:41:13 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:41:13 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:41:13 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk"/>
Nov 16 15:41:13 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:41:13 user nova-compute[74658]:     </disk>
Nov 16 15:41:13 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:41:13 user nova-compute[74658]:       <mac address="fa:16:3e:21:dd:10"/>
Nov 16 15:41:13 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:41:13 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:41:13 user nova-compute[74658]:       <target dev="tapf9b96757-d0"/>
Nov 16 15:41:13 user nova-compute[74658]:     </interface>
Nov 16 15:41:13 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:41:13 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/console.log" append="off"/>
Nov 16 15:41:13 user nova-compute[74658]:     </serial>
Nov 16 15:41:13 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:41:13 user nova-compute[74658]:     <video>
Nov 16 15:41:13 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:41:13 user nova-compute[74658]:     </video>
Nov 16 15:41:13 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:41:13 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:41:13 user nova-compute[74658]:     </rng>
Nov 16 15:41:13 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:41:13 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:41:13 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:41:13 user nova-compute[74658]:     </memballoon>
Nov 16 15:41:13 user nova-compute[74658]:   </devices>
Nov 16 15:41:13 user nova-compute[74658]: </domain>
Nov 16 15:41:13 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2071072744',display_name='tempest-VolumesNegativeTest-instance-2071072744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2071072744',id=43,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c53e53549a27497a9c9db746adaccdbd',ramdisk_id='',reservation_id='r-wf7y9w8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1877728517',owner_user_name='tempest-VolumesNegativeTest-1877728517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:41:12Z,user_data=None,user_id='5a06a787b31142a992e1741d13cb1702',uuid=0ec1e159-1e27-49ce-aa65-ad961d72ff90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9b96757-d00f-4d27-b912-7e59c192ad62", "address": "fa:16:3e:21:dd:10", "network": {"id": "9afd2405-3dd5-4d89-b3d6-806503ac8a5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6485794c78ee4e53a265b2e22a843590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b96757-d0", "ovs_interfaceid": "f9b96757-d00f-4d27-b912-7e59c192ad62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Converting VIF {"id": "f9b96757-d00f-4d27-b912-7e59c192ad62", "address": "fa:16:3e:21:dd:10", "network": {"id": "9afd2405-3dd5-4d89-b3d6-806503ac8a5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6485794c78ee4e53a265b2e22a843590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b96757-d0", "ovs_interfaceid": "f9b96757-d00f-4d27-b912-7e59c192ad62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:dd:10,bridge_name='br-int',has_traffic_filtering=True,id=f9b96757-d00f-4d27-b912-7e59c192ad62,network=Network(9afd2405-3dd5-4d89-b3d6-806503ac8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b96757-d0') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG os_vif [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:dd:10,bridge_name='br-int',has_traffic_filtering=True,id=f9b96757-d00f-4d27-b912-7e59c192ad62,network=Network(9afd2405-3dd5-4d89-b3d6-806503ac8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b96757-d0') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3458f35f-d6ce-56c6-aef7-9f7d72230f1c', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9b96757-d0, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9b96757-d0, col_values=(('qos', UUID('5cceb235-9319-4d23-ad46-21958e8df70c')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9b96757-d0, col_values=(('external_ids', {'iface-id': 'f9b96757-d00f-4d27-b912-7e59c192ad62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:dd:10', 'vm-uuid': '0ec1e159-1e27-49ce-aa65-ad961d72ff90'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:13 user nova-compute[74658]: INFO os_vif [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:dd:10,bridge_name='br-int',has_traffic_filtering=True,id=f9b96757-d00f-4d27-b912-7e59c192ad62,network=Network(9afd2405-3dd5-4d89-b3d6-806503ac8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b96757-d0')
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] No VIF found with MAC fa:16:3e:21:dd:10, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updating instance_info_cache with network_info: [{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-ad8452b7-2f6f-4d13-b892-7a8059f65d47 req-a4efbaee-1770-4cc1-88d0-69c9f1746531 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Updated VIF entry in instance network info cache for port f9b96757-d00f-4d27-b912-7e59c192ad62. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-ad8452b7-2f6f-4d13-b892-7a8059f65d47 req-a4efbaee-1770-4cc1-88d0-69c9f1746531 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Updating instance_info_cache with network_info: [{"id": "f9b96757-d00f-4d27-b912-7e59c192ad62", "address": "fa:16:3e:21:dd:10", "network": {"id": "9afd2405-3dd5-4d89-b3d6-806503ac8a5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6485794c78ee4e53a265b2e22a843590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b96757-d0", "ovs_interfaceid": "f9b96757-d00f-4d27-b912-7e59c192ad62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:41:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-ad8452b7-2f6f-4d13-b892-7a8059f65d47 req-a4efbaee-1770-4cc1-88d0-69c9f1746531 service nova] Releasing lock "refresh_cache-0ec1e159-1e27-49ce-aa65-ad961d72ff90" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:41:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:15 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:41:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-0f85be54-0986-4792-ae93-19fca9f067cb req-cb5388a4-cea0-4286-bf1d-ea6e7e6b9e0e service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Received event network-vif-plugged-f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f85be54-0986-4792-ae93-19fca9f067cb req-cb5388a4-cea0-4286-bf1d-ea6e7e6b9e0e service nova] Acquiring lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f85be54-0986-4792-ae93-19fca9f067cb req-cb5388a4-cea0-4286-bf1d-ea6e7e6b9e0e service nova] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0f85be54-0986-4792-ae93-19fca9f067cb req-cb5388a4-cea0-4286-bf1d-ea6e7e6b9e0e service nova] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-0f85be54-0986-4792-ae93-19fca9f067cb req-cb5388a4-cea0-4286-bf1d-ea6e7e6b9e0e service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] No waiting events found dispatching network-vif-plugged-f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:16 user nova-compute[74658]: WARNING nova.compute.manager [req-0f85be54-0986-4792-ae93-19fca9f067cb req-cb5388a4-cea0-4286-bf1d-ea6e7e6b9e0e service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Received unexpected event network-vif-plugged-f9b96757-d00f-4d27-b912-7e59c192ad62 for instance with vm_state building and task_state spawning.
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:41:16 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Instance spawned successfully.
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:16 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:17 user nova-compute[74658]: INFO nova.compute.manager [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 16 15:41:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:41:17 user nova-compute[74658]: INFO nova.compute.manager [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Took 6.28 seconds to build instance.
Nov 16 15:41:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a1848b6e-78d2-4506-9d68-74395bdef936 tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.401s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:18 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:41:18 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=25.327167510986328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance ad92b41d-2fe6-4e3d-877e-aebf361ddb14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 0ec1e159-1e27-49ce-aa65-ad961d72ff90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-8b8c5370-fdbb-460b-8da7-52526e5eb798 req-baa5cae8-d19c-4552-970a-9d5fcf6a3a98 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Received event network-vif-plugged-f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8b8c5370-fdbb-460b-8da7-52526e5eb798 req-baa5cae8-d19c-4552-970a-9d5fcf6a3a98 service nova] Acquiring lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8b8c5370-fdbb-460b-8da7-52526e5eb798 req-baa5cae8-d19c-4552-970a-9d5fcf6a3a98 service nova] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-8b8c5370-fdbb-460b-8da7-52526e5eb798 req-baa5cae8-d19c-4552-970a-9d5fcf6a3a98 service nova] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-8b8c5370-fdbb-460b-8da7-52526e5eb798 req-baa5cae8-d19c-4552-970a-9d5fcf6a3a98 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] No waiting events found dispatching network-vif-plugged-f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:18 user nova-compute[74658]: WARNING nova.compute.manager [req-8b8c5370-fdbb-460b-8da7-52526e5eb798 req-baa5cae8-d19c-4552-970a-9d5fcf6a3a98 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Received unexpected event network-vif-plugged-f9b96757-d00f-4d27-b912-7e59c192ad62 for instance with vm_state active and task_state None.
Nov 16 15:41:18 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:41:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:19 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:41:19 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:41:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:41:20 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:41:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:41:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:41:21 user nova-compute[74658]: INFO nova.compute.claims [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Claim successful on node user
Nov 16 15:41:21 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:41:21 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:41:22 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:41:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG nova.policy [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8c5ce8d05cb45aaab68f57932c7bcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27345ad8a963400c8c489c34b2a01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:41:22 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Creating image(s)
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "/opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "/opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "/opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.258s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk 1073741824" returned: 0 in 0.051s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Successfully created port: 5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.195s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Cannot resize image /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Ensure instance console log exists: /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Successfully updated port: 5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquired lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.compute.manager [req-140d8ce8-44f3-4c7e-8280-04500bdd8168 req-11d493f5-a049-4f82-af21-e8e9d4d3f55a service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received event network-changed-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.compute.manager [req-140d8ce8-44f3-4c7e-8280-04500bdd8168 req-11d493f5-a049-4f82-af21-e8e9d4d3f55a service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Refreshing instance network info cache due to event network-changed-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-140d8ce8-44f3-4c7e-8280-04500bdd8168 req-11d493f5-a049-4f82-af21-e8e9d4d3f55a service nova] Acquiring lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.network.neutron [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updating instance_info_cache with network_info: [{"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Releasing lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Instance network_info: |[{"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-140d8ce8-44f3-4c7e-8280-04500bdd8168 req-11d493f5-a049-4f82-af21-e8e9d4d3f55a service nova] Acquired lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.network.neutron [req-140d8ce8-44f3-4c7e-8280-04500bdd8168 req-11d493f5-a049-4f82-af21-e8e9d4d3f55a service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Refreshing network info cache for port 5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Start _get_guest_xml network_info=[{"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:41:24 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:41:24 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1596668122',display_name='tempest-TestStampPattern-server-1596668122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1596668122',id=44,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5UHoZpKJDn8GfcVJKJm5KCIx1R0uTdUsqdrzokczp8TeYcgl2pdW37FPRBDT68ysXU05V6n60jUJq9dZu0B/LXblR/2xhvonFsogYXOgSV+xpKzQB3pc6+9vdKw3zezw==',key_name='tempest-TestStampPattern-1719290655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27345ad8a963400c8c489c34b2a01416',ramdisk_id='',reservation_id='r-bishfwj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-740255138',owner_user_name='tempest-TestStampPattern-740255138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:41:22Z,user_data=None,user_id='f8c5ce8d05cb45aaab68f57932c7bcd5',uuid=710f12eb-ebbc-4f39-bee0-53d8e4d6c96e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converting VIF {"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:5b:41,bridge_name='br-int',has_traffic_filtering=True,id=5cce7a91-f7b5-4ef0-9dec-e854d4e9f131,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cce7a91-f7') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lazy-loading 'pci_devices' on Instance uuid 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:41:24 user nova-compute[74658]:   <uuid>710f12eb-ebbc-4f39-bee0-53d8e4d6c96e</uuid>
Nov 16 15:41:24 user nova-compute[74658]:   <name>instance-0000002c</name>
Nov 16 15:41:24 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:41:24 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:41:24 user nova-compute[74658]:   <metadata>
Nov 16 15:41:24 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:41:24 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:41:24 user nova-compute[74658]:       <nova:name>tempest-TestStampPattern-server-1596668122</nova:name>
Nov 16 15:41:24 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:41:24</nova:creationTime>
Nov 16 15:41:24 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:41:24 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:41:24 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:41:24 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:41:24 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:41:24 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:41:24 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:41:24 user nova-compute[74658]:       <nova:owner>
Nov 16 15:41:24 user nova-compute[74658]:         <nova:user uuid="f8c5ce8d05cb45aaab68f57932c7bcd5">tempest-TestStampPattern-740255138-project-member</nova:user>
Nov 16 15:41:24 user nova-compute[74658]:         <nova:project uuid="27345ad8a963400c8c489c34b2a01416">tempest-TestStampPattern-740255138</nova:project>
Nov 16 15:41:24 user nova-compute[74658]:       </nova:owner>
Nov 16 15:41:24 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:41:24 user nova-compute[74658]:       <nova:ports>
Nov 16 15:41:24 user nova-compute[74658]:         <nova:port uuid="5cce7a91-f7b5-4ef0-9dec-e854d4e9f131">
Nov 16 15:41:24 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 15:41:24 user nova-compute[74658]:         </nova:port>
Nov 16 15:41:24 user nova-compute[74658]:       </nova:ports>
Nov 16 15:41:24 user nova-compute[74658]:     </nova:instance>
Nov 16 15:41:24 user nova-compute[74658]:   </metadata>
Nov 16 15:41:24 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:41:24 user nova-compute[74658]:     <system>
Nov 16 15:41:24 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:41:24 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:41:24 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:41:24 user nova-compute[74658]:       <entry name="serial">710f12eb-ebbc-4f39-bee0-53d8e4d6c96e</entry>
Nov 16 15:41:24 user nova-compute[74658]:       <entry name="uuid">710f12eb-ebbc-4f39-bee0-53d8e4d6c96e</entry>
Nov 16 15:41:24 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:41:24 user nova-compute[74658]:     </system>
Nov 16 15:41:24 user nova-compute[74658]:   </sysinfo>
Nov 16 15:41:24 user nova-compute[74658]:   <os>
Nov 16 15:41:24 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:41:24 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:41:24 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:41:24 user nova-compute[74658]:   </os>
Nov 16 15:41:24 user nova-compute[74658]:   <features>
Nov 16 15:41:24 user nova-compute[74658]:     <acpi/>
Nov 16 15:41:24 user nova-compute[74658]:     <apic/>
Nov 16 15:41:24 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:41:24 user nova-compute[74658]:   </features>
Nov 16 15:41:24 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:41:24 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:41:24 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:41:24 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:41:24 user nova-compute[74658]:   </clock>
Nov 16 15:41:24 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:41:24 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:41:24 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:41:24 user nova-compute[74658]:   </cpu>
Nov 16 15:41:24 user nova-compute[74658]:   <devices>
Nov 16 15:41:24 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:41:24 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:41:24 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk"/>
Nov 16 15:41:24 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:41:24 user nova-compute[74658]:     </disk>
Nov 16 15:41:24 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:41:24 user nova-compute[74658]:       <mac address="fa:16:3e:1d:5b:41"/>
Nov 16 15:41:24 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:41:24 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:41:24 user nova-compute[74658]:       <target dev="tap5cce7a91-f7"/>
Nov 16 15:41:24 user nova-compute[74658]:     </interface>
Nov 16 15:41:24 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:41:24 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/console.log" append="off"/>
Nov 16 15:41:24 user nova-compute[74658]:     </serial>
Nov 16 15:41:24 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:41:24 user nova-compute[74658]:     <video>
Nov 16 15:41:24 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:41:24 user nova-compute[74658]:     </video>
Nov 16 15:41:24 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:41:24 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:41:24 user nova-compute[74658]:     </rng>
Nov 16 15:41:24 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:41:24 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:41:24 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:41:24 user nova-compute[74658]:     </memballoon>
Nov 16 15:41:24 user nova-compute[74658]:   </devices>
Nov 16 15:41:24 user nova-compute[74658]: </domain>
Nov 16 15:41:24 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1596668122',display_name='tempest-TestStampPattern-server-1596668122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1596668122',id=44,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5UHoZpKJDn8GfcVJKJm5KCIx1R0uTdUsqdrzokczp8TeYcgl2pdW37FPRBDT68ysXU05V6n60jUJq9dZu0B/LXblR/2xhvonFsogYXOgSV+xpKzQB3pc6+9vdKw3zezw==',key_name='tempest-TestStampPattern-1719290655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27345ad8a963400c8c489c34b2a01416',ramdisk_id='',reservation_id='r-bishfwj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-740255138',owner_user_name='tempest-TestStampPattern-740255138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:41:22Z,user_data=None,user_id='f8c5ce8d05cb45aaab68f57932c7bcd5',uuid=710f12eb-ebbc-4f39-bee0-53d8e4d6c96e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converting VIF {"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:5b:41,bridge_name='br-int',has_traffic_filtering=True,id=5cce7a91-f7b5-4ef0-9dec-e854d4e9f131,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cce7a91-f7') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG os_vif [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:5b:41,bridge_name='br-int',has_traffic_filtering=True,id=5cce7a91-f7b5-4ef0-9dec-e854d4e9f131,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cce7a91-f7') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e3f6757-625f-5657-bc8c-bf09bb1cb7f7', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cce7a91-f7, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cce7a91-f7, col_values=(('qos', UUID('1e55e1e3-e46b-4901-95a5-2fd985d88d34')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cce7a91-f7, col_values=(('external_ids', {'iface-id': '5cce7a91-f7b5-4ef0-9dec-e854d4e9f131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:5b:41', 'vm-uuid': '710f12eb-ebbc-4f39-bee0-53d8e4d6c96e'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:24 user nova-compute[74658]: INFO os_vif [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:5b:41,bridge_name='br-int',has_traffic_filtering=True,id=5cce7a91-f7b5-4ef0-9dec-e854d4e9f131,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cce7a91-f7')
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] No VIF found with MAC fa:16:3e:1d:5b:41, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.network.neutron [req-140d8ce8-44f3-4c7e-8280-04500bdd8168 req-11d493f5-a049-4f82-af21-e8e9d4d3f55a service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updated VIF entry in instance network info cache for port 5cce7a91-f7b5-4ef0-9dec-e854d4e9f131. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG nova.network.neutron [req-140d8ce8-44f3-4c7e-8280-04500bdd8168 req-11d493f5-a049-4f82-af21-e8e9d4d3f55a service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updating instance_info_cache with network_info: [{"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:41:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-140d8ce8-44f3-4c7e-8280-04500bdd8168 req-11d493f5-a049-4f82-af21-e8e9d4d3f55a service nova] Releasing lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:41:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-e663be89-d7a7-412c-9ff7-be6fcfda1def req-63cc8f03-30cf-4d12-bb38-bccd112b6124 service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received event network-vif-plugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e663be89-d7a7-412c-9ff7-be6fcfda1def req-63cc8f03-30cf-4d12-bb38-bccd112b6124 service nova] Acquiring lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e663be89-d7a7-412c-9ff7-be6fcfda1def req-63cc8f03-30cf-4d12-bb38-bccd112b6124 service nova] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e663be89-d7a7-412c-9ff7-be6fcfda1def req-63cc8f03-30cf-4d12-bb38-bccd112b6124 service nova] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:26 user nova-compute[74658]: DEBUG nova.compute.manager [req-e663be89-d7a7-412c-9ff7-be6fcfda1def req-63cc8f03-30cf-4d12-bb38-bccd112b6124 service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] No waiting events found dispatching network-vif-plugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:26 user nova-compute[74658]: WARNING nova.compute.manager [req-e663be89-d7a7-412c-9ff7-be6fcfda1def req-63cc8f03-30cf-4d12-bb38-bccd112b6124 service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received unexpected event network-vif-plugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 for instance with vm_state building and task_state spawning.
Nov 16 15:41:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG nova.compute.manager [req-e584a8fa-a6fd-4068-a1a0-57445e5f05be req-9ff03418-bb9d-4a7a-8905-ae9c100154bd service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-changed-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG nova.compute.manager [req-e584a8fa-a6fd-4068-a1a0-57445e5f05be req-9ff03418-bb9d-4a7a-8905-ae9c100154bd service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Refreshing instance network info cache due to event network-changed-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e584a8fa-a6fd-4068-a1a0-57445e5f05be req-9ff03418-bb9d-4a7a-8905-ae9c100154bd service nova] Acquiring lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e584a8fa-a6fd-4068-a1a0-57445e5f05be req-9ff03418-bb9d-4a7a-8905-ae9c100154bd service nova] Acquired lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG nova.network.neutron [req-e584a8fa-a6fd-4068-a1a0-57445e5f05be req-9ff03418-bb9d-4a7a-8905-ae9c100154bd service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Refreshing network info cache for port ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:27 user nova-compute[74658]: INFO nova.compute.manager [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Terminating instance
Nov 16 15:41:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-86071fcd-47e1-483a-969e-ec4cf98772e5 req-1b26b4ed-9b33-4d1e-85a1-70b73abf40aa service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-vif-unplugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-86071fcd-47e1-483a-969e-ec4cf98772e5 req-1b26b4ed-9b33-4d1e-85a1-70b73abf40aa service nova] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-86071fcd-47e1-483a-969e-ec4cf98772e5 req-1b26b4ed-9b33-4d1e-85a1-70b73abf40aa service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-86071fcd-47e1-483a-969e-ec4cf98772e5 req-1b26b4ed-9b33-4d1e-85a1-70b73abf40aa service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-86071fcd-47e1-483a-969e-ec4cf98772e5 req-1b26b4ed-9b33-4d1e-85a1-70b73abf40aa service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] No waiting events found dispatching network-vif-unplugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-86071fcd-47e1-483a-969e-ec4cf98772e5 req-1b26b4ed-9b33-4d1e-85a1-70b73abf40aa service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-vif-unplugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.network.neutron [req-e584a8fa-a6fd-4068-a1a0-57445e5f05be req-9ff03418-bb9d-4a7a-8905-ae9c100154bd service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updated VIF entry in instance network info cache for port ea57a3ae-37e3-4d66-8bf3-177f9303bf4f. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.network.neutron [req-e584a8fa-a6fd-4068-a1a0-57445e5f05be req-9ff03418-bb9d-4a7a-8905-ae9c100154bd service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating instance_info_cache with network_info: [{"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e584a8fa-a6fd-4068-a1a0-57445e5f05be req-9ff03418-bb9d-4a7a-8905-ae9c100154bd service nova] Releasing lock "refresh_cache-ad92b41d-2fe6-4e3d-877e-aebf361ddb14" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-29cf270a-e3cc-4f4f-8ae9-34498d291fb2 req-7d8b8ccb-5a79-4ff1-ab1f-ff3142bc0e04 service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received event network-vif-plugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-29cf270a-e3cc-4f4f-8ae9-34498d291fb2 req-7d8b8ccb-5a79-4ff1-ab1f-ff3142bc0e04 service nova] Acquiring lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-29cf270a-e3cc-4f4f-8ae9-34498d291fb2 req-7d8b8ccb-5a79-4ff1-ab1f-ff3142bc0e04 service nova] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-29cf270a-e3cc-4f4f-8ae9-34498d291fb2 req-7d8b8ccb-5a79-4ff1-ab1f-ff3142bc0e04 service nova] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-29cf270a-e3cc-4f4f-8ae9-34498d291fb2 req-7d8b8ccb-5a79-4ff1-ab1f-ff3142bc0e04 service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] No waiting events found dispatching network-vif-plugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:28 user nova-compute[74658]: WARNING nova.compute.manager [req-29cf270a-e3cc-4f4f-8ae9-34498d291fb2 req-7d8b8ccb-5a79-4ff1-ab1f-ff3142bc0e04 service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received unexpected event network-vif-plugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 for instance with vm_state building and task_state spawning.
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:41:28 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Instance spawned successfully.
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:41:28 user nova-compute[74658]: INFO nova.compute.manager [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:41:28 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Instance destroyed successfully.
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.objects.instance [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lazy-loading 'resources' on Instance uuid ad92b41d-2fe6-4e3d-877e-aebf361ddb14 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T15:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1301805927',display_name='tempest-TestShelveInstance-server-1301805927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1301805927',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPygr6WU5+gJuACnR5fZxHlm6rFQhOM6IijIWomXPqOXhz63SuWkK3DOw++IKsdq0+FUAHKg11qCi6SrKszbVnBM+8+obzPMY1A4VqSJZrmbboLiW+D8HJUau+NJ7KBcfA==',key_name='tempest-TestShelveInstance-1228229818',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:39:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61ceda4e12ea4af5bdcb9f93cae4f24c',ramdisk_id='',reservation_id='r-gsvqsadq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-182953903',owner_user_name='tempest-TestShelveInstance-182953903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:39:49Z,user_data=None,user_id='1f6f0cd0dea04b80a446774baf70b89e',uuid=ad92b41d-2fe6-4e3d-877e-aebf361ddb14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converting VIF {"id": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "address": "fa:16:3e:da:f7:24", "network": {"id": "5417d60b-20c5-46ce-828c-38385c98146e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1655417407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ceda4e12ea4af5bdcb9f93cae4f24c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea57a3ae-37", "ovs_interfaceid": "ea57a3ae-37e3-4d66-8bf3-177f9303bf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_vif [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea57a3ae-37, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c9f63a3-91aa-4f34-9910-9abf7a7ea7d4) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:28 user nova-compute[74658]: INFO os_vif [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:24,bridge_name='br-int',has_traffic_filtering=True,id=ea57a3ae-37e3-4d66-8bf3-177f9303bf4f,network=Network(5417d60b-20c5-46ce-828c-38385c98146e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea57a3ae-37')
Nov 16 15:41:28 user nova-compute[74658]: INFO nova.compute.manager [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Took 6.74 seconds to build instance.
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZujWacb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:41:28 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5408bf13-2cc9-4f4c-9bfc-6084de51115a tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.849s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a759e-2f28-4d16-8cca-25a8da48d3bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:41:28 user nova-compute[74658]: No targets found.
Nov 16 15:41:28 user nova-compute[74658]: iSNS:
Nov 16 15:41:28 user nova-compute[74658]: No targets found.
Nov 16 15:41:28 user nova-compute[74658]: STATIC:
Nov 16 15:41:28 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6
Nov 16 15:41:28 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:41:28 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:41:28 user nova-compute[74658]: FIRMWARE:
Nov 16 15:41:28 user nova-compute[74658]: No targets found.
Nov 16 15:41:28 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:41:28 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:41:28 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[54beda5a-1760-4f3f-a662-596d00a92e02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ff6de2-5dc8-405b-8c0c-268fa1d5ee01]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:41:28 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 (non-flash)
Nov 16 15:41:28 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0733dbed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[839a6e58-906a-4ceb-8005-d97ee54a3564]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[381e79bb-96a6-4a25-a710-a65e97527e27]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[81781d29-2d51-4d38-880f-ff806c1524a0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[165db13e-6a43-4876-ac06-ab01ff2ac69b]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[39add6c7-fb69-4809-86de-31ebdee87140]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe3a5b7-02f7-4391-a2c2-19081b3b0f94]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260]
Nov 16 15:41:28 user nova-compute[74658]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6, portal: 172.16.0.220,3260] successful.
Nov 16 15:41:28 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e3c39f-0623-4ee0-bba3-2bed35edf0d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee634ba1-2cea-4ad9-8afc-230cd268d53c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] <== disconnect_volume: return (315ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:41:28 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Deleting instance files /opt/stack/data/nova/instances/ad92b41d-2fe6-4e3d-877e-aebf361ddb14_del
Nov 16 15:41:28 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Deletion of /opt/stack/data/nova/instances/ad92b41d-2fe6-4e3d-877e-aebf361ddb14_del complete
Nov 16 15:41:28 user nova-compute[74658]: INFO nova.compute.manager [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 16 15:41:28 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:41:28 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:41:29 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:41:29 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Took 0.42 seconds to deallocate network for instance.
Nov 16 15:41:30 user nova-compute[74658]: DEBUG nova.compute.manager [req-636997ab-b9cf-4c1d-a2ae-411551fec892 req-8a481e6f-e585-463e-8c38-d3a511ec2e42 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-636997ab-b9cf-4c1d-a2ae-411551fec892 req-8a481e6f-e585-463e-8c38-d3a511ec2e42 service nova] Acquiring lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-636997ab-b9cf-4c1d-a2ae-411551fec892 req-8a481e6f-e585-463e-8c38-d3a511ec2e42 service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-636997ab-b9cf-4c1d-a2ae-411551fec892 req-8a481e6f-e585-463e-8c38-d3a511ec2e42 service nova] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:30 user nova-compute[74658]: DEBUG nova.compute.manager [req-636997ab-b9cf-4c1d-a2ae-411551fec892 req-8a481e6f-e585-463e-8c38-d3a511ec2e42 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] No waiting events found dispatching network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:30 user nova-compute[74658]: WARNING nova.compute.manager [req-636997ab-b9cf-4c1d-a2ae-411551fec892 req-8a481e6f-e585-463e-8c38-d3a511ec2e42 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received unexpected event network-vif-plugged-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f for instance with vm_state active and task_state deleting.
Nov 16 15:41:30 user nova-compute[74658]: INFO nova.compute.manager [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Took 0.87 seconds to detach 1 volumes for instance.
Nov 16 15:41:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Deleting volume: 94e3c39f-0623-4ee0-bba3-2bed35edf0d6 {{(pid=74658) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 15:41:30 user nova-compute[74658]: DEBUG nova.compute.manager [req-83d5eb30-b8b3-4b09-bc1c-36240c626102 req-35871652-05c6-4840-90d7-f304f68322e5 service nova] [instance: ad92b41d-2fe6-4e3d-877e-aebf361ddb14] Received event network-vif-deleted-ea57a3ae-37e3-4d66-8bf3-177f9303bf4f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:30 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:41:30 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:41:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:30 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Deleted allocations for instance ad92b41d-2fe6-4e3d-877e-aebf361ddb14
Nov 16 15:41:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-bdd473c1-bf46-4722-a5c4-155b03f9d638 tempest-TestShelveInstance-182953903 tempest-TestShelveInstance-182953903-project-member] Lock "ad92b41d-2fe6-4e3d-877e-aebf361ddb14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.149s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:41:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:44 user nova-compute[74658]: INFO nova.compute.manager [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Rescuing
Nov 16 15:41:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:41:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquired lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:41:44 user nova-compute[74658]: DEBUG nova.network.neutron [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:41:44 user nova-compute[74658]: DEBUG nova.network.neutron [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updating instance_info_cache with network_info: [{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:41:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Releasing lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:41:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-19a882a8-e0e2-4da3-bea4-fc0172cb57f1 req-afac0f76-54c6-494f-86c1-46e6e333f92b service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-19a882a8-e0e2-4da3-bea4-fc0172cb57f1 req-afac0f76-54c6-494f-86c1-46e6e333f92b service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-19a882a8-e0e2-4da3-bea4-fc0172cb57f1 req-afac0f76-54c6-494f-86c1-46e6e333f92b service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-19a882a8-e0e2-4da3-bea4-fc0172cb57f1 req-afac0f76-54c6-494f-86c1-46e6e333f92b service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:44 user nova-compute[74658]: DEBUG nova.compute.manager [req-19a882a8-e0e2-4da3-bea4-fc0172cb57f1 req-afac0f76-54c6-494f-86c1-46e6e333f92b service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:44 user nova-compute[74658]: WARNING nova.compute.manager [req-19a882a8-e0e2-4da3-bea4-fc0172cb57f1 req-afac0f76-54c6-494f-86c1-46e6e333f92b service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state active and task_state rescuing.
Nov 16 15:41:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:45 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Instance destroyed successfully.
Nov 16 15:41:45 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Attempting rescue
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74658) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Instance directory exists: not creating {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 15:41:45 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Creating image(s)
Nov 16 15:41:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "/opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'trusted_certs' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.rescue {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.rescue" returned: 0 in 0.048s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'migration_context' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.objects.base [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<82b619d5-e9e6-4e01-83f6-813de238bd5a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Start _get_guest_xml network_info=[{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "vif_mac": "fa:16:3e:a3:5d:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'resources' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.objects.base [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<82b619d5-e9e6-4e01-83f6-813de238bd5a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'numa_topology' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.objects.base [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<82b619d5-e9e6-4e01-83f6-813de238bd5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:41:45 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:41:45 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'vcpu_model' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.objects.base [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<82b619d5-e9e6-4e01-83f6-813de238bd5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-120537023',display_name='tempest-ServerRescueNegativeTestJSON-server-120537023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-120537023',id=39,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:37:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-0q0axze3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:37:07Z,user_data=None,user_id='9a638862f3424fda9cd0a29b76596857',uuid=82b619d5-e9e6-4e01-83f6-813de238bd5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "vif_mac": "fa:16:3e:a3:5d:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "vif_mac": "fa:16:3e:a3:5d:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:5d:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b2a7adb-93ed-409e-af90-6c594f623c07,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2a7adb-93') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'pci_devices' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.objects.base [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<82b619d5-e9e6-4e01-83f6-813de238bd5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:41:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:41:45 user nova-compute[74658]:   <uuid>82b619d5-e9e6-4e01-83f6-813de238bd5a</uuid>
Nov 16 15:41:45 user nova-compute[74658]:   <name>instance-00000027</name>
Nov 16 15:41:45 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:41:45 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:41:45 user nova-compute[74658]:   <metadata>
Nov 16 15:41:45 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:41:45 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:41:45 user nova-compute[74658]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-120537023</nova:name>
Nov 16 15:41:45 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:41:45</nova:creationTime>
Nov 16 15:41:45 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:41:45 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:41:45 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:41:45 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:41:45 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:41:45 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:41:45 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:41:45 user nova-compute[74658]:       <nova:owner>
Nov 16 15:41:45 user nova-compute[74658]:         <nova:user uuid="9a638862f3424fda9cd0a29b76596857">tempest-ServerRescueNegativeTestJSON-1957488214-project-member</nova:user>
Nov 16 15:41:45 user nova-compute[74658]:         <nova:project uuid="681f27eda6c74c20be18669837ace195">tempest-ServerRescueNegativeTestJSON-1957488214</nova:project>
Nov 16 15:41:45 user nova-compute[74658]:       </nova:owner>
Nov 16 15:41:45 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:41:45 user nova-compute[74658]:       <nova:ports>
Nov 16 15:41:45 user nova-compute[74658]:         <nova:port uuid="2b2a7adb-93ed-409e-af90-6c594f623c07">
Nov 16 15:41:45 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 15:41:45 user nova-compute[74658]:         </nova:port>
Nov 16 15:41:45 user nova-compute[74658]:       </nova:ports>
Nov 16 15:41:45 user nova-compute[74658]:     </nova:instance>
Nov 16 15:41:45 user nova-compute[74658]:   </metadata>
Nov 16 15:41:45 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:41:45 user nova-compute[74658]:     <system>
Nov 16 15:41:45 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:41:45 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:41:45 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:41:45 user nova-compute[74658]:       <entry name="serial">82b619d5-e9e6-4e01-83f6-813de238bd5a</entry>
Nov 16 15:41:45 user nova-compute[74658]:       <entry name="uuid">82b619d5-e9e6-4e01-83f6-813de238bd5a</entry>
Nov 16 15:41:45 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:41:45 user nova-compute[74658]:     </system>
Nov 16 15:41:45 user nova-compute[74658]:   </sysinfo>
Nov 16 15:41:45 user nova-compute[74658]:   <os>
Nov 16 15:41:45 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:41:45 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:41:45 user nova-compute[74658]:   </os>
Nov 16 15:41:45 user nova-compute[74658]:   <features>
Nov 16 15:41:45 user nova-compute[74658]:     <acpi/>
Nov 16 15:41:45 user nova-compute[74658]:     <apic/>
Nov 16 15:41:45 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:41:45 user nova-compute[74658]:   </features>
Nov 16 15:41:45 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:41:45 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:41:45 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:41:45 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:41:45 user nova-compute[74658]:   </clock>
Nov 16 15:41:45 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:41:45 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:41:45 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:41:45 user nova-compute[74658]:   </cpu>
Nov 16 15:41:45 user nova-compute[74658]:   <devices>
Nov 16 15:41:45 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:41:45 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:41:45 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.rescue"/>
Nov 16 15:41:45 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:41:45 user nova-compute[74658]:     </disk>
Nov 16 15:41:45 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:41:45 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:41:45 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk"/>
Nov 16 15:41:45 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:41:45 user nova-compute[74658]:     </disk>
Nov 16 15:41:45 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:41:45 user nova-compute[74658]:       <mac address="fa:16:3e:a3:5d:6c"/>
Nov 16 15:41:45 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:41:45 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:41:45 user nova-compute[74658]:       <target dev="tap2b2a7adb-93"/>
Nov 16 15:41:45 user nova-compute[74658]:     </interface>
Nov 16 15:41:45 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:41:45 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/console.log" append="off"/>
Nov 16 15:41:45 user nova-compute[74658]:     </serial>
Nov 16 15:41:45 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:41:45 user nova-compute[74658]:     <video>
Nov 16 15:41:45 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:41:45 user nova-compute[74658]:     </video>
Nov 16 15:41:45 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:41:45 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:41:45 user nova-compute[74658]:     </rng>
Nov 16 15:41:45 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:41:45 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:41:45 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:41:45 user nova-compute[74658]:     </memballoon>
Nov 16 15:41:45 user nova-compute[74658]:   </devices>
Nov 16 15:41:45 user nova-compute[74658]: </domain>
Nov 16 15:41:45 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:41:45 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Instance destroyed successfully.
Nov 16 15:41:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:41:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:41:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No VIF found with MAC fa:16:3e:a3:5d:6c, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:41:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-7bcf124b-68d6-4181-83a2-fe04438de5ff req-4f857194-66ac-4472-9054-498482b9bf52 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7bcf124b-68d6-4181-83a2-fe04438de5ff req-4f857194-66ac-4472-9054-498482b9bf52 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7bcf124b-68d6-4181-83a2-fe04438de5ff req-4f857194-66ac-4472-9054-498482b9bf52 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7bcf124b-68d6-4181-83a2-fe04438de5ff req-4f857194-66ac-4472-9054-498482b9bf52 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:47 user nova-compute[74658]: DEBUG nova.compute.manager [req-7bcf124b-68d6-4181-83a2-fe04438de5ff req-4f857194-66ac-4472-9054-498482b9bf52 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:47 user nova-compute[74658]: WARNING nova.compute.manager [req-7bcf124b-68d6-4181-83a2-fe04438de5ff req-4f857194-66ac-4472-9054-498482b9bf52 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state active and task_state rescuing.
Nov 16 15:41:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:49 user nova-compute[74658]: WARNING nova.compute.manager [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state active and task_state rescuing.
Nov 16 15:41:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:41:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:41:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:41:49 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:41:49 user nova-compute[74658]: DEBUG nova.compute.manager [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:41:49 user nova-compute[74658]: WARNING nova.compute.manager [req-47577015-eecc-4af3-ab5c-1fbd8320df00 req-b0cc0396-8bb5-410f-b18f-10971c8b69f9 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state active and task_state rescuing.
Nov 16 15:41:49 user nova-compute[74658]: DEBUG nova.compute.manager [None req-be17aaa4-2748-497d-8d9e-3e627cb00e4e tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:41:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:41:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:12 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:42:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:42:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:15 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:42:15 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:42:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:42:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:42:15 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:42:15 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updating instance_info_cache with network_info: [{"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:42:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:42:15 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:42:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:17 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:42:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:21 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:42:21 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:42:21 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8499MB free_disk=25.267314910888672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 0ec1e159-1e27-49ce-aa65-ad961d72ff90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:42:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:42:23 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:42:23 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:42:23 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:42:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:42:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:42:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:42:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Acquiring lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Acquiring lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:00 user nova-compute[74658]: INFO nova.compute.manager [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Terminating instance
Nov 16 15:43:01 user nova-compute[74658]: DEBUG nova.compute.manager [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-00503030-161e-4a6e-9286-beb8ff890c8c req-6441c19d-9082-4635-a597-487afcca3c59 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Received event network-vif-unplugged-f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-00503030-161e-4a6e-9286-beb8ff890c8c req-6441c19d-9082-4635-a597-487afcca3c59 service nova] Acquiring lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-00503030-161e-4a6e-9286-beb8ff890c8c req-6441c19d-9082-4635-a597-487afcca3c59 service nova] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-00503030-161e-4a6e-9286-beb8ff890c8c req-6441c19d-9082-4635-a597-487afcca3c59 service nova] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-00503030-161e-4a6e-9286-beb8ff890c8c req-6441c19d-9082-4635-a597-487afcca3c59 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] No waiting events found dispatching network-vif-unplugged-f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG nova.compute.manager [req-00503030-161e-4a6e-9286-beb8ff890c8c req-6441c19d-9082-4635-a597-487afcca3c59 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Received event network-vif-unplugged-f9b96757-d00f-4d27-b912-7e59c192ad62 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Instance destroyed successfully.
Nov 16 15:43:01 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lazy-loading 'resources' on Instance uuid 0ec1e159-1e27-49ce-aa65-ad961d72ff90 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2071072744',display_name='tempest-VolumesNegativeTest-instance-2071072744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2071072744',id=43,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c53e53549a27497a9c9db746adaccdbd',ramdisk_id='',reservation_id='r-wf7y9w8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1877728517',owner_user_name='tempest-VolumesNegativeTest-1877728517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:41:17Z,user_data=None,user_id='5a06a787b31142a992e1741d13cb1702',uuid=0ec1e159-1e27-49ce-aa65-ad961d72ff90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9b96757-d00f-4d27-b912-7e59c192ad62", "address": "fa:16:3e:21:dd:10", "network": {"id": "9afd2405-3dd5-4d89-b3d6-806503ac8a5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6485794c78ee4e53a265b2e22a843590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b96757-d0", "ovs_interfaceid": "f9b96757-d00f-4d27-b912-7e59c192ad62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Converting VIF {"id": "f9b96757-d00f-4d27-b912-7e59c192ad62", "address": "fa:16:3e:21:dd:10", "network": {"id": "9afd2405-3dd5-4d89-b3d6-806503ac8a5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6485794c78ee4e53a265b2e22a843590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b96757-d0", "ovs_interfaceid": "f9b96757-d00f-4d27-b912-7e59c192ad62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:dd:10,bridge_name='br-int',has_traffic_filtering=True,id=f9b96757-d00f-4d27-b912-7e59c192ad62,network=Network(9afd2405-3dd5-4d89-b3d6-806503ac8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b96757-d0') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG os_vif [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:dd:10,bridge_name='br-int',has_traffic_filtering=True,id=f9b96757-d00f-4d27-b912-7e59c192ad62,network=Network(9afd2405-3dd5-4d89-b3d6-806503ac8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b96757-d0') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9b96757-d0, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cceb235-9319-4d23-ad46-21958e8df70c) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:43:01 user nova-compute[74658]: INFO os_vif [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:dd:10,bridge_name='br-int',has_traffic_filtering=True,id=f9b96757-d00f-4d27-b912-7e59c192ad62,network=Network(9afd2405-3dd5-4d89-b3d6-806503ac8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b96757-d0')
Nov 16 15:43:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Deleting instance files /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90_del
Nov 16 15:43:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Deletion of /opt/stack/data/nova/instances/0ec1e159-1e27-49ce-aa65-ad961d72ff90_del complete
Nov 16 15:43:01 user nova-compute[74658]: INFO nova.compute.manager [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 16 15:43:01 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:43:01 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:43:02 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:43:02 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Took 0.60 seconds to deallocate network for instance.
Nov 16 15:43:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:02 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:43:02 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:43:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:02 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Deleted allocations for instance 0ec1e159-1e27-49ce-aa65-ad961d72ff90
Nov 16 15:43:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b0dd9d9b-3a29-4f20-be0d-19f2ba561ffc tempest-VolumesNegativeTest-1877728517 tempest-VolumesNegativeTest-1877728517-project-member] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.667s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-588edad8-7c80-4fd2-847d-de950140ed1b req-1ca21e97-5a2d-44ba-99f2-32cb58be8209 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Received event network-vif-plugged-f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:43:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-588edad8-7c80-4fd2-847d-de950140ed1b req-1ca21e97-5a2d-44ba-99f2-32cb58be8209 service nova] Acquiring lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-588edad8-7c80-4fd2-847d-de950140ed1b req-1ca21e97-5a2d-44ba-99f2-32cb58be8209 service nova] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-588edad8-7c80-4fd2-847d-de950140ed1b req-1ca21e97-5a2d-44ba-99f2-32cb58be8209 service nova] Lock "0ec1e159-1e27-49ce-aa65-ad961d72ff90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-588edad8-7c80-4fd2-847d-de950140ed1b req-1ca21e97-5a2d-44ba-99f2-32cb58be8209 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] No waiting events found dispatching network-vif-plugged-f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:43:03 user nova-compute[74658]: WARNING nova.compute.manager [req-588edad8-7c80-4fd2-847d-de950140ed1b req-1ca21e97-5a2d-44ba-99f2-32cb58be8209 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Received unexpected event network-vif-plugged-f9b96757-d00f-4d27-b912-7e59c192ad62 for instance with vm_state deleted and task_state None.
Nov 16 15:43:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-588edad8-7c80-4fd2-847d-de950140ed1b req-1ca21e97-5a2d-44ba-99f2-32cb58be8209 service nova] [instance: 0ec1e159-1e27-49ce-aa65-ad961d72ff90] Received event network-vif-deleted-f9b96757-d00f-4d27-b912-7e59c192ad62 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:43:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:43:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-c0503788-c296-41b4-8c14-d8b7e5f429d6 req-82059ea8-5578-419c-8da8-a4a69b3ac66a service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received event network-changed-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:43:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-c0503788-c296-41b4-8c14-d8b7e5f429d6 req-82059ea8-5578-419c-8da8-a4a69b3ac66a service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Refreshing instance network info cache due to event network-changed-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:43:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0503788-c296-41b4-8c14-d8b7e5f429d6 req-82059ea8-5578-419c-8da8-a4a69b3ac66a service nova] Acquiring lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:43:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0503788-c296-41b4-8c14-d8b7e5f429d6 req-82059ea8-5578-419c-8da8-a4a69b3ac66a service nova] Acquired lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:43:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-c0503788-c296-41b4-8c14-d8b7e5f429d6 req-82059ea8-5578-419c-8da8-a4a69b3ac66a service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Refreshing network info cache for port 5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-c0503788-c296-41b4-8c14-d8b7e5f429d6 req-82059ea8-5578-419c-8da8-a4a69b3ac66a service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updated VIF entry in instance network info cache for port 5cce7a91-f7b5-4ef0-9dec-e854d4e9f131. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-c0503788-c296-41b4-8c14-d8b7e5f429d6 req-82059ea8-5578-419c-8da8-a4a69b3ac66a service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updating instance_info_cache with network_info: [{"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-c0503788-c296-41b4-8c14-d8b7e5f429d6 req-82059ea8-5578-419c-8da8-a4a69b3ac66a service nova] Releasing lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG nova.objects.instance [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lazy-loading 'flavor' on Instance uuid 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:14 user nova-compute[74658]: INFO nova.compute.manager [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Attaching volume c90b9fde-a8ea-4972-a1e7-ed8292596562 to /dev/vdb
Nov 16 15:43:14 user nova-compute[74658]: DEBUG os_brick.utils [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7eada4-1e40-48e7-ab45-744e998b5287]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[53676b75-ff02-4a62-9d79-26648f224f84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c991542b-b27f-4f4b-b78e-0d0ae0967103]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8587662-b568-4963-927a-518621ff3c3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:43:14 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:43:14 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd09f01f-c5d2-4f5a-99e1-d9f93116d063]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG os_brick.utils [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:43:14 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updating existing volume attachment record: 4b00a5b7-69dc-421b-b4f5-ac094e77c1d2 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:43:15 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:15 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 15:43:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:43:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 15:43:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJuUwQAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:43:19 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:43:19 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:43:19 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd9429c-d2ef-4639-b34e-ed3139121784]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:43:19 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a42da5-a511-4ea1-b0ee-24c24a3afc1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562] added
Nov 16 15:43:19 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[702e0efe-c70f-4195-88ab-5c8cf894f9c1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[773882ba-06ec-46ff-9e2b-7325f704a37d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BJuUwQAE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BJuUwQAE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa71f634-0f60-4b99-a71a-df7faec2e7ad]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BJuUwQAE'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2873a3a7-be8a-43a9-82d2-349f8ded8fdd]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f476068a-c398-4b06-b700-e8d244ceda42]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:43:19 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:43:19 user nova-compute[74658]:  {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:43:19 user nova-compute[74658]: WARNING os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 15:43:19 user nova-compute[74658]: 
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d937cefe-f6c9-4947-9dc8-558e67335a5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562, portal: 172.16.0.220,3260]
Nov 16 15:43:19 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562, portal: 172.16.0.220,3260] successful.
Nov 16 15:43:19 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3444804a-2e9b-498e-bdc4-1557c7a3746d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae5e115-54ca-42a6-bd0b-43e52ad74b71]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 (non-flash)
Nov 16 15:43:19 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 (non-flash)
Nov 16 15:43:19 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f98a3b-55a4-40c9-957a-646e5848d791]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJuUwQAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:20 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:43:20 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8801MB free_disk=25.29278564453125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26265643465333261', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265643465333261', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.objects.instance [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lazy-loading 'flavor' on Instance uuid 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:43:20 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:43:20 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:43:20 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:43:20 user nova-compute[74658]:   <serial>c90b9fde-a8ea-4972-a1e7-ed8292596562</serial>
Nov 16 15:43:20 user nova-compute[74658]: </disk>
Nov 16 15:43:20 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 15:43:20 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 15:43:21 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 15:43:21 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:43:21 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:43:21 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:43:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:43:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:43:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] No VIF found with MAC fa:16:3e:1d:5b:41, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:43:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-9ebef9d2-f6e6-456e-8d13-1a1bfaa2034e tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.724s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:22 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:22 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:22 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:22 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:43:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:23 user nova-compute[74658]: INFO nova.compute.manager [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Detaching volume c90b9fde-a8ea-4972-a1e7-ed8292596562
Nov 16 15:43:23 user nova-compute[74658]: INFO nova.virt.block_device [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Attempting to driver detach volume c90b9fde-a8ea-4972-a1e7-ed8292596562 from mountpoint /dev/vdb
Nov 16 15:43:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Attempting to detach device vdb from instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:43:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:43:23 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:43:23 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:43:23 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:43:23 user nova-compute[74658]:   <serial>c90b9fde-a8ea-4972-a1e7-ed8292596562</serial>
Nov 16 15:43:23 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:43:23 user nova-compute[74658]: </disk>
Nov 16 15:43:23 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:43:24 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Successfully detached device vdb from instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e from the persistent domain config.
Nov 16 15:43:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:43:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:43:24 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:43:24 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:43:24 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:43:24 user nova-compute[74658]:   <serial>c90b9fde-a8ea-4972-a1e7-ed8292596562</serial>
Nov 16 15:43:24 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:43:24 user nova-compute[74658]: </disk>
Nov 16 15:43:24 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:43:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:43:25 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:27 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 15:43:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 15:43:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_power_states {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 7ec5f4b8-e749-4121-9206-4e8ddf45981d {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:35 user nova-compute[74658]: INFO nova.compute.manager [None req-2069e206-5d69-4319-b1cf-447573daa324 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Unrescuing
Nov 16 15:43:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2069e206-5d69-4319-b1cf-447573daa324 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2069e206-5d69-4319-b1cf-447573daa324 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquired lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2069e206-5d69-4319-b1cf-447573daa324 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG nova.network.neutron [None req-2069e206-5d69-4319-b1cf-447573daa324 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updating instance_info_cache with network_info: [{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2069e206-5d69-4319-b1cf-447573daa324 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Releasing lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2069e206-5d69-4319-b1cf-447573daa324 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'flavor' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-456ee9c5-9c6e-4680-a287-733d1ee06de1 req-71aeb244-c55a-4c3c-823c-e050cffd1d83 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-456ee9c5-9c6e-4680-a287-733d1ee06de1 req-71aeb244-c55a-4c3c-823c-e050cffd1d83 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-456ee9c5-9c6e-4680-a287-733d1ee06de1 req-71aeb244-c55a-4c3c-823c-e050cffd1d83 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-456ee9c5-9c6e-4680-a287-733d1ee06de1 req-71aeb244-c55a-4c3c-823c-e050cffd1d83 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-456ee9c5-9c6e-4680-a287-733d1ee06de1 req-71aeb244-c55a-4c3c-823c-e050cffd1d83 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:43:35 user nova-compute[74658]: WARNING nova.compute.manager [req-456ee9c5-9c6e-4680-a287-733d1ee06de1 req-71aeb244-c55a-4c3c-823c-e050cffd1d83 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:43:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:36 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Instance destroyed successfully.
Nov 16 15:43:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:43:37 user nova-compute[74658]: WARNING nova.compute.manager [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:43:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:43:37 user nova-compute[74658]: WARNING nova.compute.manager [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:43:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:43:37 user nova-compute[74658]: WARNING nova.compute.manager [req-02bcd9ea-d27a-4158-8c40-96154cdf9336 req-ae114c47-1f23-47bc-948e-188d0a41c230 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:43:39 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2069e206-5d69-4319-b1cf-447573daa324 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:43:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:44 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e is timed out.
Nov 16 15:43:44 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Successfully detached device vdb from instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e from the live domain config.
Nov 16 15:43:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJuUwQAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:43:44 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[895e4c67-23f8-4c28-b75e-9b968122ad56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:43:44 user nova-compute[74658]: No targets found.
Nov 16 15:43:44 user nova-compute[74658]: iSNS:
Nov 16 15:43:44 user nova-compute[74658]: No targets found.
Nov 16 15:43:44 user nova-compute[74658]: STATIC:
Nov 16 15:43:44 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562
Nov 16 15:43:44 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:43:44 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:43:44 user nova-compute[74658]: FIRMWARE:
Nov 16 15:43:44 user nova-compute[74658]: No targets found.
Nov 16 15:43:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:43:44 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:43:44 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7204de-22b0-4610-8c8e-832005b5cbd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d6353a-3c2d-4a80-bd06-8608afd2adb0]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 (non-flash)
Nov 16 15:43:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 (non-flash)
Nov 16 15:43:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07101405e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[44674c1b-6a13-4a1a-ba8b-de6c9ca49395]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[09192200-1312-45ad-966a-ae6965ae57a8]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd06d27-51e7-4fe1-b3b3-bba833e1bcec]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[57141698-a0e8-44c1-9963-ae444dcec33c]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac1056b-9526-4213-95c9-f550932ec774]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8592866-3a37-4220-978c-f76530caddf7]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562, portal: 172.16.0.220,3260]
Nov 16 15:43:44 user nova-compute[74658]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562, portal: 172.16.0.220,3260] successful.
Nov 16 15:43:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90b9fde-a8ea-4972-a1e7-ed8292596562 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6552634b-8b6b-4585-a6d5-6f37fa101112]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] <== disconnect_volume: return (284ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:43:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:43:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lazy-loading 'flavor' on Instance uuid 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:43:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-394b649b-e10f-4fec-af28-21b9dafef634 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.654s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.072s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:43:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:43:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:43:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:44:15 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:44:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:44:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:44:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:44:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:44:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:44:16 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:44:16 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:44:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:16 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updating instance_info_cache with network_info: [{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:44:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:44:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:44:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:44:17 user nova-compute[74658]: INFO nova.compute.manager [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] instance snapshotting
Nov 16 15:44:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Beginning live snapshot process
Nov 16 15:44:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json -f qcow2 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json -f qcow2 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4x8ygv_9/93b5f2a5700440faa17eab94fac37d64.delta 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:18 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4x8ygv_9/93b5f2a5700440faa17eab94fac37d64.delta 1073741824" returned: 0 in 0.054s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:18 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 15:44:18 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:44:19 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:44:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74658) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 15:44:19 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 15:44:19 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:44:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4x8ygv_9/93b5f2a5700440faa17eab94fac37d64.delta /opt/stack/data/nova/instances/snapshots/tmp4x8ygv_9/93b5f2a5700440faa17eab94fac37d64 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4x8ygv_9/93b5f2a5700440faa17eab94fac37d64.delta /opt/stack/data/nova/instances/snapshots/tmp4x8ygv_9/93b5f2a5700440faa17eab94fac37d64" returned: 0 in 0.480s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:19 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Snapshot extracted, beginning image upload
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:22 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:44:22 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:44:22 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=25.225215911865234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:44:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:22 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:44:22 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:44:22 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:44:22 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:44:22 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:44:22 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:44:22 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Snapshot image upload complete
Nov 16 15:44:22 user nova-compute[74658]: INFO nova.compute.manager [None req-c9f25b8f-a817-4d79-953b-2d70863108cd tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Took 5.32 seconds to snapshot the instance on the hypervisor.
Nov 16 15:44:22 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:44:22 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:44:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:24 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:44:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "1dc2442f-c1c9-432f-9388-58e9cc341252" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:44:25 user nova-compute[74658]: INFO nova.compute.claims [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Claim successful on node user
Nov 16 15:44:25 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:44:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:44:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG nova.policy [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8c5ce8d05cb45aaab68f57932c7bcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27345ad8a963400c8c489c34b2a01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:44:25 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Creating image(s)
Nov 16 15:44:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "/opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "/opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "/opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "c9839444d257fd6dee8cc1491dc84c23a9a04851" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "c9839444d257fd6dee8cc1491dc84c23a9a04851" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851.part --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851.part --force-share --output=json" returned: 0 in 0.264s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:26 user nova-compute[74658]: DEBUG nova.virt.images [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] 88a86e13-0955-45ea-8e3a-62309f3cb772 was qcow2, converting to raw {{(pid=74658) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 15:44:26 user nova-compute[74658]: DEBUG nova.privsep.utils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74658) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 15:44:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851.part /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851.converted {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851.part /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851.converted" returned: 0 in 0.610s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851.converted --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:27 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Successfully created port: 9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:44:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "c9839444d257fd6dee8cc1491dc84c23a9a04851" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.853s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851 --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "c9839444d257fd6dee8cc1491dc84c23a9a04851" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "c9839444d257fd6dee8cc1491dc84c23a9a04851" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851 --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851,backing_fmt=raw /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851,backing_fmt=raw /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk 1073741824" returned: 0 in 0.061s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "c9839444d257fd6dee8cc1491dc84c23a9a04851" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851 --force-share --output=json" returned: 0 in 0.195s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Ensure instance console log exists: /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Successfully updated port: 9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquired lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-4fc23eb0-37a4-49bb-9dfa-415adf577461 req-567c50ee-6c77-4f53-b6d8-1592f92d4133 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received event network-changed-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-4fc23eb0-37a4-49bb-9dfa-415adf577461 req-567c50ee-6c77-4f53-b6d8-1592f92d4133 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Refreshing instance network info cache due to event network-changed-9da6ca32-7407-4262-88b5-61d09349c85e. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:44:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4fc23eb0-37a4-49bb-9dfa-415adf577461 req-567c50ee-6c77-4f53-b6d8-1592f92d4133 service nova] Acquiring lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.network.neutron [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Updating instance_info_cache with network_info: [{"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Releasing lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Instance network_info: |[{"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4fc23eb0-37a4-49bb-9dfa-415adf577461 req-567c50ee-6c77-4f53-b6d8-1592f92d4133 service nova] Acquired lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.network.neutron [req-4fc23eb0-37a4-49bb-9dfa-415adf577461 req-567c50ee-6c77-4f53-b6d8-1592f92d4133 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Refreshing network info cache for port 9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Start _get_guest_xml network_info=[{"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0c51d523440cf8c491e89c74fbf8e351',container_format='bare',created_at=2023-11-16T15:44:17Z,direct_url=<?>,disk_format='qcow2',id=88a86e13-0955-45ea-8e3a-62309f3cb772,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1459334262',owner='27345ad8a963400c8c489c34b2a01416',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T15:44:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': '88a86e13-0955-45ea-8e3a-62309f3cb772'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:44:29 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:44:29 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c51d523440cf8c491e89c74fbf8e351',container_format='bare',created_at=2023-11-16T15:44:17Z,direct_url=<?>,disk_format='qcow2',id=88a86e13-0955-45ea-8e3a-62309f3cb772,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1459334262',owner='27345ad8a963400c8c489c34b2a01416',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T15:44:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1212361251',display_name='tempest-TestStampPattern-server-1212361251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1212361251',id=45,image_ref='88a86e13-0955-45ea-8e3a-62309f3cb772',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5UHoZpKJDn8GfcVJKJm5KCIx1R0uTdUsqdrzokczp8TeYcgl2pdW37FPRBDT68ysXU05V6n60jUJq9dZu0B/LXblR/2xhvonFsogYXOgSV+xpKzQB3pc6+9vdKw3zezw==',key_name='tempest-TestStampPattern-1719290655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27345ad8a963400c8c489c34b2a01416',ramdisk_id='',reservation_id='r-570j3nu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='710f12eb-ebbc-4f39-bee0-53d8e4d6c96e',image_min_disk='1',image_min_ram='0',image_owner_id='27345ad8a963400c8c489c34b2a01416',image_owner_project_name='tempest-TestStampPattern-740255138',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-740255138-project-member',image_user_id='f8c5ce8d05cb45aaab68f57932c7bcd5',network_allocated='True',owner_project_name='tempest-TestStampPattern-740255138',owner_user_name='tempest-TestStampPattern-740255138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:44:26Z,user_data=None,user_id='f8c5ce8d05cb45aaab68f57932c7bcd5',uuid=1dc2442f-c1c9-432f-9388-58e9cc341252,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converting VIF {"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:60:ba,bridge_name='br-int',has_traffic_filtering=True,id=9da6ca32-7407-4262-88b5-61d09349c85e,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da6ca32-74') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.objects.instance [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lazy-loading 'pci_devices' on Instance uuid 1dc2442f-c1c9-432f-9388-58e9cc341252 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:44:29 user nova-compute[74658]:   <uuid>1dc2442f-c1c9-432f-9388-58e9cc341252</uuid>
Nov 16 15:44:29 user nova-compute[74658]:   <name>instance-0000002d</name>
Nov 16 15:44:29 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:44:29 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:44:29 user nova-compute[74658]:   <metadata>
Nov 16 15:44:29 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:44:29 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:44:29 user nova-compute[74658]:       <nova:name>tempest-TestStampPattern-server-1212361251</nova:name>
Nov 16 15:44:29 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:44:29</nova:creationTime>
Nov 16 15:44:29 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:44:29 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:44:29 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:44:29 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:44:29 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:44:29 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:44:29 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:44:29 user nova-compute[74658]:       <nova:owner>
Nov 16 15:44:29 user nova-compute[74658]:         <nova:user uuid="f8c5ce8d05cb45aaab68f57932c7bcd5">tempest-TestStampPattern-740255138-project-member</nova:user>
Nov 16 15:44:29 user nova-compute[74658]:         <nova:project uuid="27345ad8a963400c8c489c34b2a01416">tempest-TestStampPattern-740255138</nova:project>
Nov 16 15:44:29 user nova-compute[74658]:       </nova:owner>
Nov 16 15:44:29 user nova-compute[74658]:       <nova:root type="image" uuid="88a86e13-0955-45ea-8e3a-62309f3cb772"/>
Nov 16 15:44:29 user nova-compute[74658]:       <nova:ports>
Nov 16 15:44:29 user nova-compute[74658]:         <nova:port uuid="9da6ca32-7407-4262-88b5-61d09349c85e">
Nov 16 15:44:29 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 15:44:29 user nova-compute[74658]:         </nova:port>
Nov 16 15:44:29 user nova-compute[74658]:       </nova:ports>
Nov 16 15:44:29 user nova-compute[74658]:     </nova:instance>
Nov 16 15:44:29 user nova-compute[74658]:   </metadata>
Nov 16 15:44:29 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:44:29 user nova-compute[74658]:     <system>
Nov 16 15:44:29 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:44:29 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:44:29 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:44:29 user nova-compute[74658]:       <entry name="serial">1dc2442f-c1c9-432f-9388-58e9cc341252</entry>
Nov 16 15:44:29 user nova-compute[74658]:       <entry name="uuid">1dc2442f-c1c9-432f-9388-58e9cc341252</entry>
Nov 16 15:44:29 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:44:29 user nova-compute[74658]:     </system>
Nov 16 15:44:29 user nova-compute[74658]:   </sysinfo>
Nov 16 15:44:29 user nova-compute[74658]:   <os>
Nov 16 15:44:29 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:44:29 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:44:29 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:44:29 user nova-compute[74658]:   </os>
Nov 16 15:44:29 user nova-compute[74658]:   <features>
Nov 16 15:44:29 user nova-compute[74658]:     <acpi/>
Nov 16 15:44:29 user nova-compute[74658]:     <apic/>
Nov 16 15:44:29 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:44:29 user nova-compute[74658]:   </features>
Nov 16 15:44:29 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:44:29 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:44:29 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:44:29 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:44:29 user nova-compute[74658]:   </clock>
Nov 16 15:44:29 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:44:29 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:44:29 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:44:29 user nova-compute[74658]:   </cpu>
Nov 16 15:44:29 user nova-compute[74658]:   <devices>
Nov 16 15:44:29 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:44:29 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:44:29 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk"/>
Nov 16 15:44:29 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:44:29 user nova-compute[74658]:     </disk>
Nov 16 15:44:29 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:44:29 user nova-compute[74658]:       <mac address="fa:16:3e:29:60:ba"/>
Nov 16 15:44:29 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:44:29 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:44:29 user nova-compute[74658]:       <target dev="tap9da6ca32-74"/>
Nov 16 15:44:29 user nova-compute[74658]:     </interface>
Nov 16 15:44:29 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:44:29 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/console.log" append="off"/>
Nov 16 15:44:29 user nova-compute[74658]:     </serial>
Nov 16 15:44:29 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:44:29 user nova-compute[74658]:     <video>
Nov 16 15:44:29 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:44:29 user nova-compute[74658]:     </video>
Nov 16 15:44:29 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:44:29 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:44:29 user nova-compute[74658]:     </rng>
Nov 16 15:44:29 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:44:29 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:44:29 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:44:29 user nova-compute[74658]:     </memballoon>
Nov 16 15:44:29 user nova-compute[74658]:   </devices>
Nov 16 15:44:29 user nova-compute[74658]: </domain>
Nov 16 15:44:29 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1212361251',display_name='tempest-TestStampPattern-server-1212361251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1212361251',id=45,image_ref='88a86e13-0955-45ea-8e3a-62309f3cb772',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5UHoZpKJDn8GfcVJKJm5KCIx1R0uTdUsqdrzokczp8TeYcgl2pdW37FPRBDT68ysXU05V6n60jUJq9dZu0B/LXblR/2xhvonFsogYXOgSV+xpKzQB3pc6+9vdKw3zezw==',key_name='tempest-TestStampPattern-1719290655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27345ad8a963400c8c489c34b2a01416',ramdisk_id='',reservation_id='r-570j3nu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='710f12eb-ebbc-4f39-bee0-53d8e4d6c96e',image_min_disk='1',image_min_ram='0',image_owner_id='27345ad8a963400c8c489c34b2a01416',image_owner_project_name='tempest-TestStampPattern-740255138',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-740255138-project-member',image_user_id='f8c5ce8d05cb45aaab68f57932c7bcd5',network_allocated='True',owner_project_name='tempest-TestStampPattern-740255138',owner_user_name='tempest-TestStampPattern-740255138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:44:26Z,user_data=None,user_id='f8c5ce8d05cb45aaab68f57932c7bcd5',uuid=1dc2442f-c1c9-432f-9388-58e9cc341252,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converting VIF {"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:60:ba,bridge_name='br-int',has_traffic_filtering=True,id=9da6ca32-7407-4262-88b5-61d09349c85e,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da6ca32-74') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG os_vif [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:60:ba,bridge_name='br-int',has_traffic_filtering=True,id=9da6ca32-7407-4262-88b5-61d09349c85e,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da6ca32-74') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0b779a1-b51b-5339-84f8-3208ffeeab60', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9da6ca32-74, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9da6ca32-74, col_values=(('qos', UUID('4f28d52f-49c7-492a-9100-93d6afe5625c')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9da6ca32-74, col_values=(('external_ids', {'iface-id': '9da6ca32-7407-4262-88b5-61d09349c85e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:60:ba', 'vm-uuid': '1dc2442f-c1c9-432f-9388-58e9cc341252'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:29 user nova-compute[74658]: INFO os_vif [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:60:ba,bridge_name='br-int',has_traffic_filtering=True,id=9da6ca32-7407-4262-88b5-61d09349c85e,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da6ca32-74')
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] No VIF found with MAC fa:16:3e:29:60:ba, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.network.neutron [req-4fc23eb0-37a4-49bb-9dfa-415adf577461 req-567c50ee-6c77-4f53-b6d8-1592f92d4133 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Updated VIF entry in instance network info cache for port 9da6ca32-7407-4262-88b5-61d09349c85e. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG nova.network.neutron [req-4fc23eb0-37a4-49bb-9dfa-415adf577461 req-567c50ee-6c77-4f53-b6d8-1592f92d4133 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Updating instance_info_cache with network_info: [{"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:44:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4fc23eb0-37a4-49bb-9dfa-415adf577461 req-567c50ee-6c77-4f53-b6d8-1592f92d4133 service nova] Releasing lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:44:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:30 user nova-compute[74658]: DEBUG nova.compute.manager [req-7ecfe4b1-3423-4e7c-82ce-2ccc7c86acb9 req-fa708dfc-aef1-4fef-8779-a6a9ec1f77cb service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received event network-vif-plugged-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:44:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7ecfe4b1-3423-4e7c-82ce-2ccc7c86acb9 req-fa708dfc-aef1-4fef-8779-a6a9ec1f77cb service nova] Acquiring lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7ecfe4b1-3423-4e7c-82ce-2ccc7c86acb9 req-fa708dfc-aef1-4fef-8779-a6a9ec1f77cb service nova] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7ecfe4b1-3423-4e7c-82ce-2ccc7c86acb9 req-fa708dfc-aef1-4fef-8779-a6a9ec1f77cb service nova] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:30 user nova-compute[74658]: DEBUG nova.compute.manager [req-7ecfe4b1-3423-4e7c-82ce-2ccc7c86acb9 req-fa708dfc-aef1-4fef-8779-a6a9ec1f77cb service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] No waiting events found dispatching network-vif-plugged-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:44:30 user nova-compute[74658]: WARNING nova.compute.manager [req-7ecfe4b1-3423-4e7c-82ce-2ccc7c86acb9 req-fa708dfc-aef1-4fef-8779-a6a9ec1f77cb service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received unexpected event network-vif-plugged-9da6ca32-7407-4262-88b5-61d09349c85e for instance with vm_state building and task_state spawning.
Nov 16 15:44:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:44:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:44:32 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Instance spawned successfully.
Nov 16 15:44:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:44:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:44:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:44:32 user nova-compute[74658]: DEBUG nova.compute.manager [req-71c7f7e3-41a2-401a-8dc6-546b8142483a req-c12d8ec4-8850-49fd-8042-211331864828 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received event network-vif-plugged-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:44:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-71c7f7e3-41a2-401a-8dc6-546b8142483a req-c12d8ec4-8850-49fd-8042-211331864828 service nova] Acquiring lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-71c7f7e3-41a2-401a-8dc6-546b8142483a req-c12d8ec4-8850-49fd-8042-211331864828 service nova] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-71c7f7e3-41a2-401a-8dc6-546b8142483a req-c12d8ec4-8850-49fd-8042-211331864828 service nova] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:32 user nova-compute[74658]: DEBUG nova.compute.manager [req-71c7f7e3-41a2-401a-8dc6-546b8142483a req-c12d8ec4-8850-49fd-8042-211331864828 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] No waiting events found dispatching network-vif-plugged-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:44:32 user nova-compute[74658]: WARNING nova.compute.manager [req-71c7f7e3-41a2-401a-8dc6-546b8142483a req-c12d8ec4-8850-49fd-8042-211331864828 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received unexpected event network-vif-plugged-9da6ca32-7407-4262-88b5-61d09349c85e for instance with vm_state building and task_state spawning.
Nov 16 15:44:32 user nova-compute[74658]: INFO nova.compute.manager [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Took 6.93 seconds to spawn the instance on the hypervisor.
Nov 16 15:44:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:44:32 user nova-compute[74658]: INFO nova.compute.manager [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Took 7.59 seconds to build instance.
Nov 16 15:44:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a81ae2e4-642a-4412-9e3d-7942a84a6ed3 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.681s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:44:33 user nova-compute[74658]: INFO nova.compute.claims [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Claim successful on node user
Nov 16 15:44:33 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:44:33 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:44:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG nova.policy [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ebcfc6cb72e4a928b909180131604f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567b17081c594217accb2f14f30e9abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:44:33 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Creating image(s)
Nov 16 15:44:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "/opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "/opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.217s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.262s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk 1073741824" returned: 0 in 0.056s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.217s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Successfully created port: 05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Cannot resize image /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Ensure instance console log exists: /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Successfully updated port: 05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquired lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-64637eee-3ac5-42e5-8fc9-24dee061090f req-ce88e05a-d382-4a6e-9ff9-b724bd6de6bb service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Received event network-changed-05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-64637eee-3ac5-42e5-8fc9-24dee061090f req-ce88e05a-d382-4a6e-9ff9-b724bd6de6bb service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Refreshing instance network info cache due to event network-changed-05355b9a-433f-441e-bbcc-3bbfa6348768. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-64637eee-3ac5-42e5-8fc9-24dee061090f req-ce88e05a-d382-4a6e-9ff9-b724bd6de6bb service nova] Acquiring lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.network.neutron [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updating instance_info_cache with network_info: [{"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Releasing lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Instance network_info: |[{"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-64637eee-3ac5-42e5-8fc9-24dee061090f req-ce88e05a-d382-4a6e-9ff9-b724bd6de6bb service nova] Acquired lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.network.neutron [req-64637eee-3ac5-42e5-8fc9-24dee061090f req-ce88e05a-d382-4a6e-9ff9-b724bd6de6bb service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Refreshing network info cache for port 05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Start _get_guest_xml network_info=[{"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:44:35 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:44:35 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:44:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1141095029',display_name='tempest-SnapshotDataIntegrityTests-server-1141095029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1141095029',id=46,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Al/v42pdlG5+4pNP11AwApUD70i3NVNrDReacM6xW2oouO7jnI0wlDsUphjgczmp93Na9rXKR/3CEtCRFO83Pq0yqN+nN/gB/tWXh8yaMsG0ZBJoj4j7Q4mMTndDcRw==',key_name='tempest-keypair-1052283175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='567b17081c594217accb2f14f30e9abb',ramdisk_id='',reservation_id='r-xq3uh1om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1996730971',owner_user_name='tempest-SnapshotDataIntegrityTests-1996730971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:44:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ebcfc6cb72e4a928b909180131604f7',uuid=0dc36262-5767-4282-886a-f16a89472332,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Converting VIF {"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:fd:8d,bridge_name='br-int',has_traffic_filtering=True,id=05355b9a-433f-441e-bbcc-3bbfa6348768,network=Network(ce3c3b92-55fa-4a58-bcd7-f66d3962a49f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05355b9a-43') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.objects.instance [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:44:35 user nova-compute[74658]:   <uuid>0dc36262-5767-4282-886a-f16a89472332</uuid>
Nov 16 15:44:35 user nova-compute[74658]:   <name>instance-0000002e</name>
Nov 16 15:44:35 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:44:35 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:44:35 user nova-compute[74658]:   <metadata>
Nov 16 15:44:35 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:44:35 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:44:35 user nova-compute[74658]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1141095029</nova:name>
Nov 16 15:44:35 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:44:35</nova:creationTime>
Nov 16 15:44:35 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:44:35 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:44:35 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:44:35 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:44:35 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:44:35 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:44:35 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:44:35 user nova-compute[74658]:       <nova:owner>
Nov 16 15:44:35 user nova-compute[74658]:         <nova:user uuid="5ebcfc6cb72e4a928b909180131604f7">tempest-SnapshotDataIntegrityTests-1996730971-project-member</nova:user>
Nov 16 15:44:35 user nova-compute[74658]:         <nova:project uuid="567b17081c594217accb2f14f30e9abb">tempest-SnapshotDataIntegrityTests-1996730971</nova:project>
Nov 16 15:44:35 user nova-compute[74658]:       </nova:owner>
Nov 16 15:44:35 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:44:35 user nova-compute[74658]:       <nova:ports>
Nov 16 15:44:35 user nova-compute[74658]:         <nova:port uuid="05355b9a-433f-441e-bbcc-3bbfa6348768">
Nov 16 15:44:35 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 15:44:35 user nova-compute[74658]:         </nova:port>
Nov 16 15:44:35 user nova-compute[74658]:       </nova:ports>
Nov 16 15:44:35 user nova-compute[74658]:     </nova:instance>
Nov 16 15:44:35 user nova-compute[74658]:   </metadata>
Nov 16 15:44:35 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:44:35 user nova-compute[74658]:     <system>
Nov 16 15:44:35 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:44:35 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:44:35 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:44:35 user nova-compute[74658]:       <entry name="serial">0dc36262-5767-4282-886a-f16a89472332</entry>
Nov 16 15:44:35 user nova-compute[74658]:       <entry name="uuid">0dc36262-5767-4282-886a-f16a89472332</entry>
Nov 16 15:44:35 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:44:35 user nova-compute[74658]:     </system>
Nov 16 15:44:35 user nova-compute[74658]:   </sysinfo>
Nov 16 15:44:35 user nova-compute[74658]:   <os>
Nov 16 15:44:35 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:44:35 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:44:35 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:44:35 user nova-compute[74658]:   </os>
Nov 16 15:44:35 user nova-compute[74658]:   <features>
Nov 16 15:44:35 user nova-compute[74658]:     <acpi/>
Nov 16 15:44:35 user nova-compute[74658]:     <apic/>
Nov 16 15:44:35 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:44:35 user nova-compute[74658]:   </features>
Nov 16 15:44:35 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:44:35 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:44:35 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:44:35 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:44:35 user nova-compute[74658]:   </clock>
Nov 16 15:44:35 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:44:35 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:44:35 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:44:35 user nova-compute[74658]:   </cpu>
Nov 16 15:44:35 user nova-compute[74658]:   <devices>
Nov 16 15:44:35 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:44:35 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:44:35 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk"/>
Nov 16 15:44:35 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:44:35 user nova-compute[74658]:     </disk>
Nov 16 15:44:35 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:44:35 user nova-compute[74658]:       <mac address="fa:16:3e:ef:fd:8d"/>
Nov 16 15:44:35 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:44:35 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:44:35 user nova-compute[74658]:       <target dev="tap05355b9a-43"/>
Nov 16 15:44:35 user nova-compute[74658]:     </interface>
Nov 16 15:44:35 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:44:35 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/console.log" append="off"/>
Nov 16 15:44:35 user nova-compute[74658]:     </serial>
Nov 16 15:44:35 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:44:35 user nova-compute[74658]:     <video>
Nov 16 15:44:35 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:44:35 user nova-compute[74658]:     </video>
Nov 16 15:44:35 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:44:35 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:44:35 user nova-compute[74658]:     </rng>
Nov 16 15:44:35 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:44:35 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:44:35 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:44:35 user nova-compute[74658]:     </memballoon>
Nov 16 15:44:35 user nova-compute[74658]:   </devices>
Nov 16 15:44:35 user nova-compute[74658]: </domain>
Nov 16 15:44:35 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:44:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1141095029',display_name='tempest-SnapshotDataIntegrityTests-server-1141095029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1141095029',id=46,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Al/v42pdlG5+4pNP11AwApUD70i3NVNrDReacM6xW2oouO7jnI0wlDsUphjgczmp93Na9rXKR/3CEtCRFO83Pq0yqN+nN/gB/tWXh8yaMsG0ZBJoj4j7Q4mMTndDcRw==',key_name='tempest-keypair-1052283175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='567b17081c594217accb2f14f30e9abb',ramdisk_id='',reservation_id='r-xq3uh1om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1996730971',owner_user_name='tempest-SnapshotDataIntegrityTests-1996730971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:44:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ebcfc6cb72e4a928b909180131604f7',uuid=0dc36262-5767-4282-886a-f16a89472332,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Converting VIF {"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:fd:8d,bridge_name='br-int',has_traffic_filtering=True,id=05355b9a-433f-441e-bbcc-3bbfa6348768,network=Network(ce3c3b92-55fa-4a58-bcd7-f66d3962a49f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05355b9a-43') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG os_vif [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:fd:8d,bridge_name='br-int',has_traffic_filtering=True,id=05355b9a-433f-441e-bbcc-3bbfa6348768,network=Network(ce3c3b92-55fa-4a58-bcd7-f66d3962a49f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05355b9a-43') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d76f197-afef-58f8-af7f-bfc89e4bca8e', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05355b9a-43, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05355b9a-43, col_values=(('qos', UUID('8d6db0c0-aebf-465a-b2cf-072183b5bdcd')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05355b9a-43, col_values=(('external_ids', {'iface-id': '05355b9a-433f-441e-bbcc-3bbfa6348768', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:fd:8d', 'vm-uuid': '0dc36262-5767-4282-886a-f16a89472332'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:35 user nova-compute[74658]: INFO os_vif [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:fd:8d,bridge_name='br-int',has_traffic_filtering=True,id=05355b9a-433f-441e-bbcc-3bbfa6348768,network=Network(ce3c3b92-55fa-4a58-bcd7-f66d3962a49f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05355b9a-43')
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No VIF found with MAC fa:16:3e:ef:fd:8d, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:44:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:36 user nova-compute[74658]: DEBUG nova.network.neutron [req-64637eee-3ac5-42e5-8fc9-24dee061090f req-ce88e05a-d382-4a6e-9ff9-b724bd6de6bb service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updated VIF entry in instance network info cache for port 05355b9a-433f-441e-bbcc-3bbfa6348768. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:44:36 user nova-compute[74658]: DEBUG nova.network.neutron [req-64637eee-3ac5-42e5-8fc9-24dee061090f req-ce88e05a-d382-4a6e-9ff9-b724bd6de6bb service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updating instance_info_cache with network_info: [{"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:44:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-64637eee-3ac5-42e5-8fc9-24dee061090f req-ce88e05a-d382-4a6e-9ff9-b724bd6de6bb service nova] Releasing lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:44:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-26ebb414-d269-421e-a775-65a3d58c4c4e req-ccd3f721-4e99-452c-86e9-cbf2959c287e service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Received event network-vif-plugged-05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:44:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-26ebb414-d269-421e-a775-65a3d58c4c4e req-ccd3f721-4e99-452c-86e9-cbf2959c287e service nova] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-26ebb414-d269-421e-a775-65a3d58c4c4e req-ccd3f721-4e99-452c-86e9-cbf2959c287e service nova] Lock "0dc36262-5767-4282-886a-f16a89472332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-26ebb414-d269-421e-a775-65a3d58c4c4e req-ccd3f721-4e99-452c-86e9-cbf2959c287e service nova] Lock "0dc36262-5767-4282-886a-f16a89472332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:37 user nova-compute[74658]: DEBUG nova.compute.manager [req-26ebb414-d269-421e-a775-65a3d58c4c4e req-ccd3f721-4e99-452c-86e9-cbf2959c287e service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] No waiting events found dispatching network-vif-plugged-05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:44:37 user nova-compute[74658]: WARNING nova.compute.manager [req-26ebb414-d269-421e-a775-65a3d58c4c4e req-ccd3f721-4e99-452c-86e9-cbf2959c287e service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Received unexpected event network-vif-plugged-05355b9a-433f-441e-bbcc-3bbfa6348768 for instance with vm_state building and task_state spawning.
Nov 16 15:44:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:44:39 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 0dc36262-5767-4282-886a-f16a89472332] Instance spawned successfully.
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:44:39 user nova-compute[74658]: INFO nova.compute.manager [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.compute.manager [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-f3c2fe1a-d50b-46ec-831a-8ab426e858cb req-ded4e6c5-bab9-4935-ab9b-e3659d31180c service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Received event network-vif-plugged-05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f3c2fe1a-d50b-46ec-831a-8ab426e858cb req-ded4e6c5-bab9-4935-ab9b-e3659d31180c service nova] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f3c2fe1a-d50b-46ec-831a-8ab426e858cb req-ded4e6c5-bab9-4935-ab9b-e3659d31180c service nova] Lock "0dc36262-5767-4282-886a-f16a89472332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f3c2fe1a-d50b-46ec-831a-8ab426e858cb req-ded4e6c5-bab9-4935-ab9b-e3659d31180c service nova] Lock "0dc36262-5767-4282-886a-f16a89472332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:39 user nova-compute[74658]: DEBUG nova.compute.manager [req-f3c2fe1a-d50b-46ec-831a-8ab426e858cb req-ded4e6c5-bab9-4935-ab9b-e3659d31180c service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] No waiting events found dispatching network-vif-plugged-05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:44:39 user nova-compute[74658]: WARNING nova.compute.manager [req-f3c2fe1a-d50b-46ec-831a-8ab426e858cb req-ded4e6c5-bab9-4935-ab9b-e3659d31180c service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Received unexpected event network-vif-plugged-05355b9a-433f-441e-bbcc-3bbfa6348768 for instance with vm_state building and task_state spawning.
Nov 16 15:44:39 user nova-compute[74658]: INFO nova.compute.manager [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Took 6.32 seconds to build instance.
Nov 16 15:44:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-01003700-68b0-4903-aa13-7caff47c50e5 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.521s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:44:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:44:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:44:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:44:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:44:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:44:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:44:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:13 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:45:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:45:18 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:45:18 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:45:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:45:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:45:18 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:45:18 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updating instance_info_cache with network_info: [{"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:45:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:45:18 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:22 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:45:22 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:45:22 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8511MB free_disk=25.090442657470703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:45:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:45:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:45:23 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:45:23 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:45:23 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:45:23 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 1dc2442f-c1c9-432f-9388-58e9cc341252 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:45:23 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 0dc36262-5767-4282-886a-f16a89472332 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:45:23 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:45:23 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:45:23 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:45:23 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:45:23 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:45:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:45:25 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:45:25 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:45:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:45:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:45:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:45:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:45:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:45:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:45:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:45:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:45:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:45:30 user nova-compute[74658]: INFO nova.compute.claims [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Claim successful on node user
Nov 16 15:45:30 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:45:30 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:45:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG nova.policy [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a638862f3424fda9cd0a29b76596857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681f27eda6c74c20be18669837ace195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:45:30 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Creating image(s)
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "/opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.167s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.167s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk 1073741824" returned: 0 in 0.046s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:45:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.167s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Successfully created port: 28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Cannot resize image /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Ensure instance console log exists: /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Successfully updated port: 28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquired lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-0dd0f388-40cc-424c-b59b-ecbe28305a65 req-2fb4a4ce-d7cb-45fe-8e5c-7aa78e421a18 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-changed-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-0dd0f388-40cc-424c-b59b-ecbe28305a65 req-2fb4a4ce-d7cb-45fe-8e5c-7aa78e421a18 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Refreshing instance network info cache due to event network-changed-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0dd0f388-40cc-424c-b59b-ecbe28305a65 req-2fb4a4ce-d7cb-45fe-8e5c-7aa78e421a18 service nova] Acquiring lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:45:31 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updating instance_info_cache with network_info: [{"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Releasing lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Instance network_info: |[{"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0dd0f388-40cc-424c-b59b-ecbe28305a65 req-2fb4a4ce-d7cb-45fe-8e5c-7aa78e421a18 service nova] Acquired lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.network.neutron [req-0dd0f388-40cc-424c-b59b-ecbe28305a65 req-2fb4a4ce-d7cb-45fe-8e5c-7aa78e421a18 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Refreshing network info cache for port 28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Start _get_guest_xml network_info=[{"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:45:32 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:45:32 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1216046020',display_name='tempest-ServerRescueNegativeTestJSON-server-1216046020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1216046020',id=47,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiRbqkkZZ6oDLl/CvWxCHYdB9Pymo6TQ78DbQptid02AGqsgtX1IXkfOueOfcHF+LDP9erTIjqovfOGgCFkkEkkGNYoDiwKQDZbyXPcW5WM/ouxTcRL0Z4eQEUQFxR6Kg==',key_name='tempest-keypair-929872367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-5rjpmfpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a638862f3424fda9cd0a29b76596857',uuid=cca2e870-3378-4f24-839c-5655157e8c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=28e7d197-878a-4e5f-97a0-fa0e1d2feaa2,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7d197-87') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.objects.instance [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'pci_devices' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:45:32 user nova-compute[74658]:   <uuid>cca2e870-3378-4f24-839c-5655157e8c52</uuid>
Nov 16 15:45:32 user nova-compute[74658]:   <name>instance-0000002f</name>
Nov 16 15:45:32 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:45:32 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:45:32 user nova-compute[74658]:   <metadata>
Nov 16 15:45:32 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:45:32 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:45:32 user nova-compute[74658]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1216046020</nova:name>
Nov 16 15:45:32 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:45:32</nova:creationTime>
Nov 16 15:45:32 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:45:32 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:45:32 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:45:32 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:45:32 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:45:32 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:45:32 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:45:32 user nova-compute[74658]:       <nova:owner>
Nov 16 15:45:32 user nova-compute[74658]:         <nova:user uuid="9a638862f3424fda9cd0a29b76596857">tempest-ServerRescueNegativeTestJSON-1957488214-project-member</nova:user>
Nov 16 15:45:32 user nova-compute[74658]:         <nova:project uuid="681f27eda6c74c20be18669837ace195">tempest-ServerRescueNegativeTestJSON-1957488214</nova:project>
Nov 16 15:45:32 user nova-compute[74658]:       </nova:owner>
Nov 16 15:45:32 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:45:32 user nova-compute[74658]:       <nova:ports>
Nov 16 15:45:32 user nova-compute[74658]:         <nova:port uuid="28e7d197-878a-4e5f-97a0-fa0e1d2feaa2">
Nov 16 15:45:32 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 15:45:32 user nova-compute[74658]:         </nova:port>
Nov 16 15:45:32 user nova-compute[74658]:       </nova:ports>
Nov 16 15:45:32 user nova-compute[74658]:     </nova:instance>
Nov 16 15:45:32 user nova-compute[74658]:   </metadata>
Nov 16 15:45:32 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:45:32 user nova-compute[74658]:     <system>
Nov 16 15:45:32 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:45:32 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:45:32 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:45:32 user nova-compute[74658]:       <entry name="serial">cca2e870-3378-4f24-839c-5655157e8c52</entry>
Nov 16 15:45:32 user nova-compute[74658]:       <entry name="uuid">cca2e870-3378-4f24-839c-5655157e8c52</entry>
Nov 16 15:45:32 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:45:32 user nova-compute[74658]:     </system>
Nov 16 15:45:32 user nova-compute[74658]:   </sysinfo>
Nov 16 15:45:32 user nova-compute[74658]:   <os>
Nov 16 15:45:32 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:45:32 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:45:32 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:45:32 user nova-compute[74658]:   </os>
Nov 16 15:45:32 user nova-compute[74658]:   <features>
Nov 16 15:45:32 user nova-compute[74658]:     <acpi/>
Nov 16 15:45:32 user nova-compute[74658]:     <apic/>
Nov 16 15:45:32 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:45:32 user nova-compute[74658]:   </features>
Nov 16 15:45:32 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:45:32 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:45:32 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:45:32 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:45:32 user nova-compute[74658]:   </clock>
Nov 16 15:45:32 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:45:32 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:45:32 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:45:32 user nova-compute[74658]:   </cpu>
Nov 16 15:45:32 user nova-compute[74658]:   <devices>
Nov 16 15:45:32 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:45:32 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:45:32 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk"/>
Nov 16 15:45:32 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:45:32 user nova-compute[74658]:     </disk>
Nov 16 15:45:32 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:45:32 user nova-compute[74658]:       <mac address="fa:16:3e:9b:0a:ca"/>
Nov 16 15:45:32 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:45:32 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:45:32 user nova-compute[74658]:       <target dev="tap28e7d197-87"/>
Nov 16 15:45:32 user nova-compute[74658]:     </interface>
Nov 16 15:45:32 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:45:32 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/console.log" append="off"/>
Nov 16 15:45:32 user nova-compute[74658]:     </serial>
Nov 16 15:45:32 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:45:32 user nova-compute[74658]:     <video>
Nov 16 15:45:32 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:45:32 user nova-compute[74658]:     </video>
Nov 16 15:45:32 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:45:32 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:45:32 user nova-compute[74658]:     </rng>
Nov 16 15:45:32 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:45:32 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:45:32 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:45:32 user nova-compute[74658]:     </memballoon>
Nov 16 15:45:32 user nova-compute[74658]:   </devices>
Nov 16 15:45:32 user nova-compute[74658]: </domain>
Nov 16 15:45:32 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1216046020',display_name='tempest-ServerRescueNegativeTestJSON-server-1216046020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1216046020',id=47,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiRbqkkZZ6oDLl/CvWxCHYdB9Pymo6TQ78DbQptid02AGqsgtX1IXkfOueOfcHF+LDP9erTIjqovfOGgCFkkEkkGNYoDiwKQDZbyXPcW5WM/ouxTcRL0Z4eQEUQFxR6Kg==',key_name='tempest-keypair-929872367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-5rjpmfpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a638862f3424fda9cd0a29b76596857',uuid=cca2e870-3378-4f24-839c-5655157e8c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=28e7d197-878a-4e5f-97a0-fa0e1d2feaa2,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7d197-87') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG os_vif [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=28e7d197-878a-4e5f-97a0-fa0e1d2feaa2,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7d197-87') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5df5d10b-5c94-5cf0-8302-4cd7d91b3658', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28e7d197-87, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28e7d197-87, col_values=(('qos', UUID('3b48e233-b71a-486e-ad7f-f60eecb2d450')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28e7d197-87, col_values=(('external_ids', {'iface-id': '28e7d197-878a-4e5f-97a0-fa0e1d2feaa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:0a:ca', 'vm-uuid': 'cca2e870-3378-4f24-839c-5655157e8c52'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:32 user nova-compute[74658]: INFO os_vif [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=28e7d197-878a-4e5f-97a0-fa0e1d2feaa2,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7d197-87')
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No VIF found with MAC fa:16:3e:9b:0a:ca, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.network.neutron [req-0dd0f388-40cc-424c-b59b-ecbe28305a65 req-2fb4a4ce-d7cb-45fe-8e5c-7aa78e421a18 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updated VIF entry in instance network info cache for port 28e7d197-878a-4e5f-97a0-fa0e1d2feaa2. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG nova.network.neutron [req-0dd0f388-40cc-424c-b59b-ecbe28305a65 req-2fb4a4ce-d7cb-45fe-8e5c-7aa78e421a18 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updating instance_info_cache with network_info: [{"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:45:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0dd0f388-40cc-424c-b59b-ecbe28305a65 req-2fb4a4ce-d7cb-45fe-8e5c-7aa78e421a18 service nova] Releasing lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:45:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-215a07e8-0f41-4d51-8fb2-e7c5d27f071f req-d3f66513-4a6e-4172-92e8-7b27d1bbecb3 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:45:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-215a07e8-0f41-4d51-8fb2-e7c5d27f071f req-d3f66513-4a6e-4172-92e8-7b27d1bbecb3 service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:45:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-215a07e8-0f41-4d51-8fb2-e7c5d27f071f req-d3f66513-4a6e-4172-92e8-7b27d1bbecb3 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:45:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-215a07e8-0f41-4d51-8fb2-e7c5d27f071f req-d3f66513-4a6e-4172-92e8-7b27d1bbecb3 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:45:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-215a07e8-0f41-4d51-8fb2-e7c5d27f071f req-d3f66513-4a6e-4172-92e8-7b27d1bbecb3 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:45:33 user nova-compute[74658]: WARNING nova.compute.manager [req-215a07e8-0f41-4d51-8fb2-e7c5d27f071f req-d3f66513-4a6e-4172-92e8-7b27d1bbecb3 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received unexpected event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with vm_state building and task_state spawning.
Nov 16 15:45:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:45:35 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Instance spawned successfully.
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-4a2a0762-f327-4e30-b35e-d97037855dda req-34190a49-4c08-49bb-9188-28da3f63aa21 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4a2a0762-f327-4e30-b35e-d97037855dda req-34190a49-4c08-49bb-9188-28da3f63aa21 service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4a2a0762-f327-4e30-b35e-d97037855dda req-34190a49-4c08-49bb-9188-28da3f63aa21 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4a2a0762-f327-4e30-b35e-d97037855dda req-34190a49-4c08-49bb-9188-28da3f63aa21 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.compute.manager [req-4a2a0762-f327-4e30-b35e-d97037855dda req-34190a49-4c08-49bb-9188-28da3f63aa21 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:45:35 user nova-compute[74658]: WARNING nova.compute.manager [req-4a2a0762-f327-4e30-b35e-d97037855dda req-34190a49-4c08-49bb-9188-28da3f63aa21 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received unexpected event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with vm_state building and task_state spawning.
Nov 16 15:45:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:35 user nova-compute[74658]: INFO nova.compute.manager [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 16 15:45:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:45:36 user nova-compute[74658]: INFO nova.compute.manager [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Took 6.06 seconds to build instance.
Nov 16 15:45:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c1cfc1f9-2094-4c38-b24e-cfc423808670 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.160s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:45:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:45:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:15 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:46:16 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:46:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-9ebc5cb0-fedf-4a98-9913-6db0b17850f0 req-cc77a719-e381-4d2d-893a-473d0cbf5622 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received event network-changed-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:46:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-9ebc5cb0-fedf-4a98-9913-6db0b17850f0 req-cc77a719-e381-4d2d-893a-473d0cbf5622 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Refreshing instance network info cache due to event network-changed-9da6ca32-7407-4262-88b5-61d09349c85e. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:46:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9ebc5cb0-fedf-4a98-9913-6db0b17850f0 req-cc77a719-e381-4d2d-893a-473d0cbf5622 service nova] Acquiring lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:46:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9ebc5cb0-fedf-4a98-9913-6db0b17850f0 req-cc77a719-e381-4d2d-893a-473d0cbf5622 service nova] Acquired lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:46:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-9ebc5cb0-fedf-4a98-9913-6db0b17850f0 req-cc77a719-e381-4d2d-893a-473d0cbf5622 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Refreshing network info cache for port 9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:46:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-9ebc5cb0-fedf-4a98-9913-6db0b17850f0 req-cc77a719-e381-4d2d-893a-473d0cbf5622 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Updated VIF entry in instance network info cache for port 9da6ca32-7407-4262-88b5-61d09349c85e. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:46:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-9ebc5cb0-fedf-4a98-9913-6db0b17850f0 req-cc77a719-e381-4d2d-893a-473d0cbf5622 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Updating instance_info_cache with network_info: [{"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:46:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-9ebc5cb0-fedf-4a98-9913-6db0b17850f0 req-cc77a719-e381-4d2d-893a-473d0cbf5622 service nova] Releasing lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "1dc2442f-c1c9-432f-9388-58e9cc341252" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lazy-loading 'flavor' on Instance uuid 1dc2442f-c1c9-432f-9388-58e9cc341252 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "1dc2442f-c1c9-432f-9388-58e9cc341252" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:46:17 user nova-compute[74658]: INFO nova.compute.manager [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Attaching volume c0003307-53d0-4c17-b7f0-4a728dcd036e to /dev/vdb
Nov 16 15:46:17 user nova-compute[74658]: DEBUG os_brick.utils [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7984a51d-4e31-40c3-bd9f-4e5f49eeac68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a414d22-6db3-4624-8d53-e9c2660079ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7434d2d1-cfc5-448a-ac12-72037acf0290]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[553dab4d-d4dc-4309-9606-d8600e25836f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:46:17 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:46:17 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d4ee47-fc9d-476f-9dc2-c5324e5e6038]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG os_brick.utils [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:46:17 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Updating existing volume attachment record: d35edbb0-9f62-496d-88ed-5d4cf2803a6e {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:46:19 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:46:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:46:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:46:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:46:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:46:19 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updating instance_info_cache with network_info: [{"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:46:19 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:46:19 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:46:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:46:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBFtlCTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:46:22 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:46:22 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:46:22 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:46:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[62946e81-4690-4eb1-8aa5-525b3455da91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:46:22 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cdb43a-5923-44de-8000-4bafcc1b45fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e] added
Nov 16 15:46:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7a2792-b2bc-4e06-93a6-c48c748ee344]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dfbba4-8e89-4f5d-837f-c3bf562f0b31]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SBFtlCTU {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SBFtlCTU" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ccd7a9-cc32-456b-baeb-aaf8fd35a346]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SBFtlCTU'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f26e0fe-7b3d-4402-8b3a-d92df5ceb7a5]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef6093a-99e5-48ce-9744-e873d6647aa8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:46:22 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:46:22 user nova-compute[74658]:  {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:46:22 user nova-compute[74658]: WARNING os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 15:46:22 user nova-compute[74658]: 
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[78098bd8-5c98-4775-9f5e-c4174572f307]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e, portal: 172.16.0.220,3260]
Nov 16 15:46:22 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e, portal: 172.16.0.220,3260] successful.
Nov 16 15:46:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a256711-fa7b-4f39-9021-32f116d7452c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e69133-c0fc-47fe-b10f-175ce2e9a625]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)
Nov 16 15:46:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)
Nov 16 15:46:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1506a2-88ba-4e6d-aafa-5137630f966c]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBFtlCTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23261396363376262', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261396363376262', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lazy-loading 'flavor' on Instance uuid 1dc2442f-c1c9-432f-9388-58e9cc341252 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:46:23 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:46:23 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:46:23 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:46:23 user nova-compute[74658]:   <serial>c0003307-53d0-4c17-b7f0-4a728dcd036e</serial>
Nov 16 15:46:23 user nova-compute[74658]: </disk>
Nov 16 15:46:23 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-14d4acba-8bef-4c90-9683-8309ce9acb30 req-b6726dcf-d56b-4753-856d-910eee72b2ab service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Received event network-changed-05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-14d4acba-8bef-4c90-9683-8309ce9acb30 req-b6726dcf-d56b-4753-856d-910eee72b2ab service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Refreshing instance network info cache due to event network-changed-05355b9a-433f-441e-bbcc-3bbfa6348768. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-14d4acba-8bef-4c90-9683-8309ce9acb30 req-b6726dcf-d56b-4753-856d-910eee72b2ab service nova] Acquiring lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-14d4acba-8bef-4c90-9683-8309ce9acb30 req-b6726dcf-d56b-4753-856d-910eee72b2ab service nova] Acquired lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG nova.network.neutron [req-14d4acba-8bef-4c90-9683-8309ce9acb30 req-b6726dcf-d56b-4753-856d-910eee72b2ab service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Refreshing network info cache for port 05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] No VIF found with MAC fa:16:3e:29:60:ba, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:24 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:46:24 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=25.060516357421875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a9fabc0-9641-4d2d-bb5e-b400ee135dd2 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.192s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 1dc2442f-c1c9-432f-9388-58e9cc341252 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 0dc36262-5767-4282-886a-f16a89472332 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance cca2e870-3378-4f24-839c-5655157e8c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.network.neutron [req-14d4acba-8bef-4c90-9683-8309ce9acb30 req-b6726dcf-d56b-4753-856d-910eee72b2ab service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updated VIF entry in instance network info cache for port 05355b9a-433f-441e-bbcc-3bbfa6348768. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.network.neutron [req-14d4acba-8bef-4c90-9683-8309ce9acb30 req-b6726dcf-d56b-4753-856d-910eee72b2ab service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updating instance_info_cache with network_info: [{"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-14d4acba-8bef-4c90-9683-8309ce9acb30 req-b6726dcf-d56b-4753-856d-910eee72b2ab service nova] Releasing lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:46:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:46:25 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:46:25 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:46:25 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:46:25 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:46:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "1dc2442f-c1c9-432f-9388-58e9cc341252" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:46:26 user nova-compute[74658]: INFO nova.compute.manager [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Detaching volume c0003307-53d0-4c17-b7f0-4a728dcd036e
Nov 16 15:46:26 user nova-compute[74658]: INFO nova.virt.block_device [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Attempting to driver detach volume c0003307-53d0-4c17-b7f0-4a728dcd036e from mountpoint /dev/vdb
Nov 16 15:46:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Attempting to detach device vdb from instance 1dc2442f-c1c9-432f-9388-58e9cc341252 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:46:26 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:46:26 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:46:26 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:46:26 user nova-compute[74658]:   <serial>c0003307-53d0-4c17-b7f0-4a728dcd036e</serial>
Nov 16 15:46:26 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:46:26 user nova-compute[74658]: </disk>
Nov 16 15:46:26 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:46:26 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Successfully detached device vdb from instance 1dc2442f-c1c9-432f-9388-58e9cc341252 from the persistent domain config.
Nov 16 15:46:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1dc2442f-c1c9-432f-9388-58e9cc341252 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:46:26 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:46:26 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:46:26 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:46:26 user nova-compute[74658]:   <serial>c0003307-53d0-4c17-b7f0-4a728dcd036e</serial>
Nov 16 15:46:26 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:46:26 user nova-compute[74658]: </disk>
Nov 16 15:46:26 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:46:26 user nova-compute[74658]: INFO nova.compute.manager [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attaching volume 1131bf91-d015-47c5-8520-4fc2e425360c to /dev/vdb
Nov 16 15:46:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1dc2442f-c1c9-432f-9388-58e9cc341252 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG os_brick.utils [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[894779a6-bde6-440b-80d0-c835b7ee725f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea212f3-5c51-4ce0-af57-c321591af4ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c2c7cf-d833-4fb0-9b69-d9a83a4dadbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b349b90-90db-41e3-a8af-c6f7517c5fcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:46:26 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:46:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9c2a74-426d-4e57-9e55-e208c33daa24]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG os_brick.utils [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:46:26 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updating existing volume attachment record: 2b0ada9c-0aa4-4bdd-b64a-b128c9291f21 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:46:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SUMcPuXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:46:31 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:46:31 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:46:31 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce400da6-e738-4c6c-b555-a4b92f876046]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:46:31 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e406726e-2f6a-4765-a27e-5202b895cd75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c] added
Nov 16 15:46:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e28ac4-9743-498a-8454-9ee0e1ca74bf]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c63785e-e4c3-4983-b762-ffa7ade469e7]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SUMcPuXg {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SUMcPuXg" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4a5fac-5d30-4444-9cd8-3dc29ff0cf96]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SUMcPuXg'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc527e09-3c73-4595-b5e5-cb4ed065df28]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[473bf784-6e5e-4371-9f58-422542cfbe0d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)
Nov 16 15:46:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)
Nov 16 15:46:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7228c831-63b6-4e9e-8cae-2b15dd921d7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c, portal: 172.16.0.220,3260]
Nov 16 15:46:31 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c, portal: 172.16.0.220,3260] successful.
Nov 16 15:46:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c8c9fc-0d96-4f87-80b2-401bbc16167d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c0b5a1-5767-4da6-9935-ded258459544]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)
Nov 16 15:46:31 user nova-compute[74658]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c (non-flash)
Nov 16 15:46:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)
Nov 16 15:46:31 user nova-compute[74658]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c (non-flash)
Nov 16 15:46:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[688e503b-136d-4c02-aebe-fe21eda8aa06]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:46:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SUMcPuXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:46:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:46:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23435626238346636', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:46:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435626238346636', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:46:32 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:46:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:46:32 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:46:32 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:46:32 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:46:32 user nova-compute[74658]:   <serial>1131bf91-d015-47c5-8520-4fc2e425360c</serial>
Nov 16 15:46:32 user nova-compute[74658]: </disk>
Nov 16 15:46:32 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:46:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:46:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:46:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No VIF found with MAC fa:16:3e:ef:fd:8d, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:46:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0557091c-31c0-4a2c-ae8f-30dba63df5af tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.810s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:46:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:46:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:46:43 user nova-compute[74658]: INFO nova.compute.manager [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Detaching volume 1131bf91-d015-47c5-8520-4fc2e425360c
Nov 16 15:46:44 user nova-compute[74658]: INFO nova.virt.block_device [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attempting to driver detach volume 1131bf91-d015-47c5-8520-4fc2e425360c from mountpoint /dev/vdb
Nov 16 15:46:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Attempting to detach device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:46:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:46:44 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:46:44 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:46:44 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:46:44 user nova-compute[74658]:   <serial>1131bf91-d015-47c5-8520-4fc2e425360c</serial>
Nov 16 15:46:44 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:46:44 user nova-compute[74658]: </disk>
Nov 16 15:46:44 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:46:44 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Successfully detached device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the persistent domain config.
Nov 16 15:46:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dc36262-5767-4282-886a-f16a89472332 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:46:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:46:44 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:46:44 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:46:44 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:46:44 user nova-compute[74658]:   <serial>1131bf91-d015-47c5-8520-4fc2e425360c</serial>
Nov 16 15:46:44 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:46:44 user nova-compute[74658]: </disk>
Nov 16 15:46:44 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:46:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:46:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:46 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1dc2442f-c1c9-432f-9388-58e9cc341252 is timed out.
Nov 16 15:46:46 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Successfully detached device vdb from instance 1dc2442f-c1c9-432f-9388-58e9cc341252 from the live domain config.
Nov 16 15:46:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBFtlCTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:46:46 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[46402f58-6310-419a-b84e-c4de8651cfde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:46:46 user nova-compute[74658]: No targets found.
Nov 16 15:46:46 user nova-compute[74658]: iSNS:
Nov 16 15:46:46 user nova-compute[74658]: No targets found.
Nov 16 15:46:46 user nova-compute[74658]: STATIC:
Nov 16 15:46:46 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c
Nov 16 15:46:46 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:46:46 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:46:46 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e
Nov 16 15:46:46 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:46:46 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:46:46 user nova-compute[74658]: FIRMWARE:
Nov 16 15:46:46 user nova-compute[74658]: No targets found.
Nov 16 15:46:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:46:46 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:46:46 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[972c97bc-b5f8-4830-8829-78ebbb660fa4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8524624-4b0b-45fe-9030-0102ed2add42]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)
Nov 16 15:46:46 user nova-compute[74658]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c (non-flash)
Nov 16 15:46:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e (non-flash)
Nov 16 15:46:46 user nova-compute[74658]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c (non-flash)
Nov 16 15:46:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710630670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6135673-d408-46f7-bfa5-f13fe8aa4fd1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc319ddf-ac8e-40a1-8e28-b9da31c92bfd]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e2cf9e-b218-4f37-a944-27c2c11b7ffc]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d5f5cd-2d0c-4a6b-905f-10c5681909e1]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a2a90-71aa-4f9d-8497-066454ac35f4]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc65b80-a91b-4068-90e9-e61ce742025d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e, portal: 172.16.0.220,3260]
Nov 16 15:46:46 user nova-compute[74658]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e, portal: 172.16.0.220,3260] successful.
Nov 16 15:46:46 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0003307-53d0-4c17-b7f0-4a728dcd036e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5f339b-d30b-44aa-816e-aa3d0dd299bc]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] <== disconnect_volume: return (287ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:46:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:46:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:47 user nova-compute[74658]: DEBUG nova.objects.instance [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lazy-loading 'flavor' on Instance uuid 1dc2442f-c1c9-432f-9388-58e9cc341252 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:46:47 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-53cea685-f5ef-4d3e-8bb8-3e28a4876265 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.620s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:46:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:46:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:47:04 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dc36262-5767-4282-886a-f16a89472332 is timed out.
Nov 16 15:47:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Successfully detached device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the live domain config.
Nov 16 15:47:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SUMcPuXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:47:04 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2657c6-4a9d-4291-9bcb-aeea1c23abc1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:47:04 user nova-compute[74658]: No targets found.
Nov 16 15:47:04 user nova-compute[74658]: iSNS:
Nov 16 15:47:04 user nova-compute[74658]: No targets found.
Nov 16 15:47:04 user nova-compute[74658]: STATIC:
Nov 16 15:47:04 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c
Nov 16 15:47:04 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:47:04 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:47:04 user nova-compute[74658]: FIRMWARE:
Nov 16 15:47:04 user nova-compute[74658]: No targets found.
Nov 16 15:47:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:47:04 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:47:04 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a1172f-9fdc-4a9c-9400-d378e3b7393d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e22061-e98b-4ba1-947b-90b875e42f21]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c (non-flash)
Nov 16 15:47:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c (non-flash)
Nov 16 15:47:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07103897e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a0b944-16f5-4e15-84b4-9e220989c6ac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2c1265-5352-4eca-93d4-9e6a94d65adc]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bd2971-a88d-48b1-b068-0dc3cebee42c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa36493-9513-4dce-ad34-7a72156c677c]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbd9259-b013-4f2a-b426-60e22b87c217]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd63285d-e4ca-4694-913e-95610bad76d0]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c, portal: 172.16.0.220,3260]
Nov 16 15:47:04 user nova-compute[74658]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c, portal: 172.16.0.220,3260] successful.
Nov 16 15:47:04 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1131bf91-d015-47c5-8520-4fc2e425360c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc5f2ab-3177-425c-ab95-eef38ecdfa6a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== disconnect_volume: return (303ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:47:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:47:05 user nova-compute[74658]: DEBUG nova.objects.instance [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-de33fd09-572b-45bd-bc46-f4410f57815e tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.771s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:47:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:47:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:47:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:47:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:47:15 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-76419f6f-215a-4080-ba62-4884d81247d2 req-0fbf94b7-1b58-4021-b1b8-945534cbe07a service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received event network-changed-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-76419f6f-215a-4080-ba62-4884d81247d2 req-0fbf94b7-1b58-4021-b1b8-945534cbe07a service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Refreshing instance network info cache due to event network-changed-9da6ca32-7407-4262-88b5-61d09349c85e. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-76419f6f-215a-4080-ba62-4884d81247d2 req-0fbf94b7-1b58-4021-b1b8-945534cbe07a service nova] Acquiring lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-76419f6f-215a-4080-ba62-4884d81247d2 req-0fbf94b7-1b58-4021-b1b8-945534cbe07a service nova] Acquired lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG nova.network.neutron [req-76419f6f-215a-4080-ba62-4884d81247d2 req-0fbf94b7-1b58-4021-b1b8-945534cbe07a service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Refreshing network info cache for port 9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "1dc2442f-c1c9-432f-9388-58e9cc341252" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:16 user nova-compute[74658]: INFO nova.compute.manager [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Terminating instance
Nov 16 15:47:16 user nova-compute[74658]: DEBUG nova.compute.manager [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG nova.network.neutron [req-76419f6f-215a-4080-ba62-4884d81247d2 req-0fbf94b7-1b58-4021-b1b8-945534cbe07a service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Updated VIF entry in instance network info cache for port 9da6ca32-7407-4262-88b5-61d09349c85e. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG nova.network.neutron [req-76419f6f-215a-4080-ba62-4884d81247d2 req-0fbf94b7-1b58-4021-b1b8-945534cbe07a service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Updating instance_info_cache with network_info: [{"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-76419f6f-215a-4080-ba62-4884d81247d2 req-0fbf94b7-1b58-4021-b1b8-945534cbe07a service nova] Releasing lock "refresh_cache-1dc2442f-c1c9-432f-9388-58e9cc341252" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:47:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Instance destroyed successfully.
Nov 16 15:47:17 user nova-compute[74658]: DEBUG nova.objects.instance [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lazy-loading 'resources' on Instance uuid 1dc2442f-c1c9-432f-9388-58e9cc341252 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1212361251',display_name='tempest-TestStampPattern-server-1212361251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1212361251',id=45,image_ref='88a86e13-0955-45ea-8e3a-62309f3cb772',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5UHoZpKJDn8GfcVJKJm5KCIx1R0uTdUsqdrzokczp8TeYcgl2pdW37FPRBDT68ysXU05V6n60jUJq9dZu0B/LXblR/2xhvonFsogYXOgSV+xpKzQB3pc6+9vdKw3zezw==',key_name='tempest-TestStampPattern-1719290655',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:44:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27345ad8a963400c8c489c34b2a01416',ramdisk_id='',reservation_id='r-570j3nu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='710f12eb-ebbc-4f39-bee0-53d8e4d6c96e',image_min_disk='1',image_min_ram='0',image_owner_id='27345ad8a963400c8c489c34b2a01416',image_owner_project_name='tempest-TestStampPattern-740255138',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-740255138-project-member',image_user_id='f8c5ce8d05cb45aaab68f57932c7bcd5',owner_project_name='tempest-TestStampPattern-740255138',owner_user_name='tempest-TestStampPattern-740255138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:44:33Z,user_data=None,user_id='f8c5ce8d05cb45aaab68f57932c7bcd5',uuid=1dc2442f-c1c9-432f-9388-58e9cc341252,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converting VIF {"id": "9da6ca32-7407-4262-88b5-61d09349c85e", "address": "fa:16:3e:29:60:ba", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da6ca32-74", "ovs_interfaceid": "9da6ca32-7407-4262-88b5-61d09349c85e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:60:ba,bridge_name='br-int',has_traffic_filtering=True,id=9da6ca32-7407-4262-88b5-61d09349c85e,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da6ca32-74') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG os_vif [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:60:ba,bridge_name='br-int',has_traffic_filtering=True,id=9da6ca32-7407-4262-88b5-61d09349c85e,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da6ca32-74') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9da6ca32-74, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f28d52f-49c7-492a-9100-93d6afe5625c) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:17 user nova-compute[74658]: INFO os_vif [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:60:ba,bridge_name='br-int',has_traffic_filtering=True,id=9da6ca32-7407-4262-88b5-61d09349c85e,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da6ca32-74')
Nov 16 15:47:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Deleting instance files /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252_del
Nov 16 15:47:17 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Deletion of /opt/stack/data/nova/instances/1dc2442f-c1c9-432f-9388-58e9cc341252_del complete
Nov 16 15:47:17 user nova-compute[74658]: INFO nova.compute.manager [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 16 15:47:17 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:47:17 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-8c7beff6-1fa1-4611-bd68-c1985545f7b3 req-7d61d626-f469-46eb-9a0d-1c8075fb3822 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received event network-vif-deleted-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:47:18 user nova-compute[74658]: INFO nova.compute.manager [req-8c7beff6-1fa1-4611-bd68-c1985545f7b3 req-7d61d626-f469-46eb-9a0d-1c8075fb3822 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Neutron deleted interface 9da6ca32-7407-4262-88b5-61d09349c85e; detaching it from the instance and deleting it from the info cache
Nov 16 15:47:18 user nova-compute[74658]: DEBUG nova.network.neutron [req-8c7beff6-1fa1-4611-bd68-c1985545f7b3 req-7d61d626-f469-46eb-9a0d-1c8075fb3822 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:47:18 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Took 0.52 seconds to deallocate network for instance.
Nov 16 15:47:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-8c7beff6-1fa1-4611-bd68-c1985545f7b3 req-7d61d626-f469-46eb-9a0d-1c8075fb3822 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Detach interface failed, port_id=9da6ca32-7407-4262-88b5-61d09349c85e, reason: Instance 1dc2442f-c1c9-432f-9388-58e9cc341252 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:18 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Deleted allocations for instance 1dc2442f-c1c9-432f-9388-58e9cc341252
Nov 16 15:47:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6fe0c26a-cefe-4ab3-b8d8-52e17d53bd58 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received event network-vif-unplugged-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] Acquiring lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] No waiting events found dispatching network-vif-unplugged-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:47:18 user nova-compute[74658]: WARNING nova.compute.manager [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received unexpected event network-vif-unplugged-9da6ca32-7407-4262-88b5-61d09349c85e for instance with vm_state deleted and task_state None.
Nov 16 15:47:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received event network-vif-plugged-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] Acquiring lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] Lock "1dc2442f-c1c9-432f-9388-58e9cc341252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] No waiting events found dispatching network-vif-plugged-9da6ca32-7407-4262-88b5-61d09349c85e {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:47:18 user nova-compute[74658]: WARNING nova.compute.manager [req-83de5233-7dad-40fc-9191-35f9cc1b542c req-6bc62ea8-abe9-494a-b4db-a4f201f8e581 service nova] [instance: 1dc2442f-c1c9-432f-9388-58e9cc341252] Received unexpected event network-vif-plugged-9da6ca32-7407-4262-88b5-61d09349c85e for instance with vm_state deleted and task_state None.
Nov 16 15:47:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc6102c7-de17-4546-ae58-06f6650e9d1e req-31f81642-7765-43e8-83ad-2c2d6aae36ef service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-changed-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:47:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-fc6102c7-de17-4546-ae58-06f6650e9d1e req-31f81642-7765-43e8-83ad-2c2d6aae36ef service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Refreshing instance network info cache due to event network-changed-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:47:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc6102c7-de17-4546-ae58-06f6650e9d1e req-31f81642-7765-43e8-83ad-2c2d6aae36ef service nova] Acquiring lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:47:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc6102c7-de17-4546-ae58-06f6650e9d1e req-31f81642-7765-43e8-83ad-2c2d6aae36ef service nova] Acquired lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:47:20 user nova-compute[74658]: DEBUG nova.network.neutron [req-fc6102c7-de17-4546-ae58-06f6650e9d1e req-31f81642-7765-43e8-83ad-2c2d6aae36ef service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Refreshing network info cache for port 28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:47:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG nova.objects.instance [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'flavor' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:21 user nova-compute[74658]: INFO nova.compute.manager [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Attaching volume 7beab1ee-29da-4570-a9a5-89860c247a97 to /dev/vdb
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG os_brick.utils [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9ab7d6-353d-45dd-8ba2-8ec7c0efac7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4005fa9-b5b5-40e0-8bba-22e8813d28f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d67e97f-a01a-41ff-ad94-17c6336bd9b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb8bf5b-2893-41a0-8c7e-ed078764cc4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:47:21 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7d9009-c7bf-475b-a623-a3330eb31d16]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG os_brick.utils [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updating existing volume attachment record: 15620357-0b01-4e2d-b017-e1c9d29f6c33 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG nova.network.neutron [req-fc6102c7-de17-4546-ae58-06f6650e9d1e req-31f81642-7765-43e8-83ad-2c2d6aae36ef service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updated VIF entry in instance network info cache for port 28e7d197-878a-4e5f-97a0-fa0e1d2feaa2. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG nova.network.neutron [req-fc6102c7-de17-4546-ae58-06f6650e9d1e req-31f81642-7765-43e8-83ad-2c2d6aae36ef service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updating instance_info_cache with network_info: [{"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-fc6102c7-de17-4546-ae58-06f6650e9d1e req-31f81642-7765-43e8-83ad-2c2d6aae36ef service nova] Releasing lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updating instance_info_cache with network_info: [{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:47:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:24 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:47:24 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:47:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8553MB free_disk=25.059856414794922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:47:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 0dc36262-5767-4282-886a-f16a89472332 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance cca2e870-3378-4f24-839c-5655157e8c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACYWpMhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:47:26 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:47:26 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:47:26 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[065b23dd-198e-4c7a-99dc-3bd6b571c44c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:47:26 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86becfb-1e0b-49c6-82a9-5b63e34f314a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97] added
Nov 16 15:47:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd0266a-aa06-4a82-96b3-c5f0a420e88e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[949f9c70-969a-4959-8582-b9589ff44dc8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ACYWpMhL {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ACYWpMhL" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be64b8a-c078-43ea-b870-bba1b46f7600]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ACYWpMhL'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0374d03-98e7-40ed-a521-21e09c9fe68c]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[910fea2b-952d-4f63-b8ef-c7dfbab5946c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:47:26 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:47:26 user nova-compute[74658]:  {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:47:26 user nova-compute[74658]: WARNING os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 15:47:26 user nova-compute[74658]: 
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[94961085-d715-4a6d-8501-53836abb53de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97, portal: 172.16.0.220,3260]
Nov 16 15:47:26 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97, portal: 172.16.0.220,3260] successful.
Nov 16 15:47:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a6e429-1d2f-4225-ab87-0524ee603556]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4132f7fc-672c-4208-bd48-eeb4326e8dde]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:47:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:47:26 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f8c289-6e57-477d-8a5d-fd4cb3dfb769]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:47:26 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACYWpMhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:47:27 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:47:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:47:27 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23965633039316237', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:47:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965633039316237', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:47:27 user nova-compute[74658]: DEBUG nova.objects.instance [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'flavor' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:47:27 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:47:27 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:47:27 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:47:27 user nova-compute[74658]:   <serial>7beab1ee-29da-4570-a9a5-89860c247a97</serial>
Nov 16 15:47:27 user nova-compute[74658]: </disk>
Nov 16 15:47:27 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:47:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:47:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:47:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No VIF found with MAC fa:16:3e:9b:0a:ca, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:47:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c8d578b1-4d04-44df-82fa-9cd61de84ff0 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.895s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:28 user nova-compute[74658]: INFO nova.compute.manager [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Rescuing
Nov 16 15:47:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:47:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquired lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:47:28 user nova-compute[74658]: DEBUG nova.network.neutron [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:47:29 user nova-compute[74658]: DEBUG nova.network.neutron [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updating instance_info_cache with network_info: [{"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:47:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Releasing lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:47:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-7c6ba440-5c09-445e-9bc1-ef6a7dca39e8 req-f25fe503-83db-4d39-b69a-462d64dc5706 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-unplugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:47:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c6ba440-5c09-445e-9bc1-ef6a7dca39e8 req-f25fe503-83db-4d39-b69a-462d64dc5706 service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c6ba440-5c09-445e-9bc1-ef6a7dca39e8 req-f25fe503-83db-4d39-b69a-462d64dc5706 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-7c6ba440-5c09-445e-9bc1-ef6a7dca39e8 req-f25fe503-83db-4d39-b69a-462d64dc5706 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-7c6ba440-5c09-445e-9bc1-ef6a7dca39e8 req-f25fe503-83db-4d39-b69a-462d64dc5706 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-unplugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:47:29 user nova-compute[74658]: WARNING nova.compute.manager [req-7c6ba440-5c09-445e-9bc1-ef6a7dca39e8 req-f25fe503-83db-4d39-b69a-462d64dc5706 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received unexpected event network-vif-unplugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with vm_state active and task_state rescuing.
Nov 16 15:47:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:30 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Instance destroyed successfully.
Nov 16 15:47:30 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Attempting rescue
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74658) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Instance directory exists: not creating {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 15:47:30 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Creating image(s)
Nov 16 15:47:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "/opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "/opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.objects.instance [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'trusted_certs' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.169s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.rescue {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.rescue" returned: 0 in 0.048s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.objects.instance [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'migration_context' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.objects.base [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<cca2e870-3378-4f24-839c-5655157e8c52> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Start _get_guest_xml network_info=[{"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "vif_mac": "fa:16:3e:9b:0a:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.objects.instance [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'resources' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.objects.base [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<cca2e870-3378-4f24-839c-5655157e8c52> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.objects.instance [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'numa_topology' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.objects.base [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<cca2e870-3378-4f24-839c-5655157e8c52> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:47:30 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:47:30 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.objects.instance [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'vcpu_model' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.objects.base [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<cca2e870-3378-4f24-839c-5655157e8c52> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1216046020',display_name='tempest-ServerRescueNegativeTestJSON-server-1216046020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1216046020',id=47,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiRbqkkZZ6oDLl/CvWxCHYdB9Pymo6TQ78DbQptid02AGqsgtX1IXkfOueOfcHF+LDP9erTIjqovfOGgCFkkEkkGNYoDiwKQDZbyXPcW5WM/ouxTcRL0Z4eQEUQFxR6Kg==',key_name='tempest-keypair-929872367',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-5rjpmfpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a638862f3424fda9cd0a29b76596857',uuid=cca2e870-3378-4f24-839c-5655157e8c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "vif_mac": "fa:16:3e:9b:0a:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "vif_mac": "fa:16:3e:9b:0a:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=28e7d197-878a-4e5f-97a0-fa0e1d2feaa2,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7d197-87') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.objects.instance [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'pci_devices' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.objects.base [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Object Instance<cca2e870-3378-4f24-839c-5655157e8c52> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74658) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:47:30 user nova-compute[74658]:   <uuid>cca2e870-3378-4f24-839c-5655157e8c52</uuid>
Nov 16 15:47:30 user nova-compute[74658]:   <name>instance-0000002f</name>
Nov 16 15:47:30 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:47:30 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:47:30 user nova-compute[74658]:   <metadata>
Nov 16 15:47:30 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:47:30 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:47:30 user nova-compute[74658]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1216046020</nova:name>
Nov 16 15:47:30 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:47:30</nova:creationTime>
Nov 16 15:47:30 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:47:30 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:47:30 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:47:30 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:47:30 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:47:30 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:47:30 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:47:30 user nova-compute[74658]:       <nova:owner>
Nov 16 15:47:30 user nova-compute[74658]:         <nova:user uuid="9a638862f3424fda9cd0a29b76596857">tempest-ServerRescueNegativeTestJSON-1957488214-project-member</nova:user>
Nov 16 15:47:30 user nova-compute[74658]:         <nova:project uuid="681f27eda6c74c20be18669837ace195">tempest-ServerRescueNegativeTestJSON-1957488214</nova:project>
Nov 16 15:47:30 user nova-compute[74658]:       </nova:owner>
Nov 16 15:47:30 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:47:30 user nova-compute[74658]:       <nova:ports>
Nov 16 15:47:30 user nova-compute[74658]:         <nova:port uuid="28e7d197-878a-4e5f-97a0-fa0e1d2feaa2">
Nov 16 15:47:30 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 15:47:30 user nova-compute[74658]:         </nova:port>
Nov 16 15:47:30 user nova-compute[74658]:       </nova:ports>
Nov 16 15:47:30 user nova-compute[74658]:     </nova:instance>
Nov 16 15:47:30 user nova-compute[74658]:   </metadata>
Nov 16 15:47:30 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:47:30 user nova-compute[74658]:     <system>
Nov 16 15:47:30 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:47:30 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:47:30 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:47:30 user nova-compute[74658]:       <entry name="serial">cca2e870-3378-4f24-839c-5655157e8c52</entry>
Nov 16 15:47:30 user nova-compute[74658]:       <entry name="uuid">cca2e870-3378-4f24-839c-5655157e8c52</entry>
Nov 16 15:47:30 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:47:30 user nova-compute[74658]:     </system>
Nov 16 15:47:30 user nova-compute[74658]:   </sysinfo>
Nov 16 15:47:30 user nova-compute[74658]:   <os>
Nov 16 15:47:30 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:47:30 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:47:30 user nova-compute[74658]:   </os>
Nov 16 15:47:30 user nova-compute[74658]:   <features>
Nov 16 15:47:30 user nova-compute[74658]:     <acpi/>
Nov 16 15:47:30 user nova-compute[74658]:     <apic/>
Nov 16 15:47:30 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:47:30 user nova-compute[74658]:   </features>
Nov 16 15:47:30 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:47:30 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:47:30 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:47:30 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:47:30 user nova-compute[74658]:   </clock>
Nov 16 15:47:30 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:47:30 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:47:30 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:47:30 user nova-compute[74658]:   </cpu>
Nov 16 15:47:30 user nova-compute[74658]:   <devices>
Nov 16 15:47:30 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:47:30 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:47:30 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.rescue"/>
Nov 16 15:47:30 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:47:30 user nova-compute[74658]:     </disk>
Nov 16 15:47:30 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:47:30 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:47:30 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk"/>
Nov 16 15:47:30 user nova-compute[74658]:       <target dev="vdb" bus="virtio"/>
Nov 16 15:47:30 user nova-compute[74658]:     </disk>
Nov 16 15:47:30 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:47:30 user nova-compute[74658]:       <mac address="fa:16:3e:9b:0a:ca"/>
Nov 16 15:47:30 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:47:30 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:47:30 user nova-compute[74658]:       <target dev="tap28e7d197-87"/>
Nov 16 15:47:30 user nova-compute[74658]:     </interface>
Nov 16 15:47:30 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:47:30 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/console.log" append="off"/>
Nov 16 15:47:30 user nova-compute[74658]:     </serial>
Nov 16 15:47:30 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:47:30 user nova-compute[74658]:     <video>
Nov 16 15:47:30 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:47:30 user nova-compute[74658]:     </video>
Nov 16 15:47:30 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:47:30 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:47:30 user nova-compute[74658]:     </rng>
Nov 16 15:47:30 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:47:30 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:47:30 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:47:30 user nova-compute[74658]:     </memballoon>
Nov 16 15:47:30 user nova-compute[74658]:   </devices>
Nov 16 15:47:30 user nova-compute[74658]: </domain>
Nov 16 15:47:30 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:47:30 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Instance destroyed successfully.
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] No VIF found with MAC fa:16:3e:9b:0a:ca, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:47:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-90a62ae9-a87f-484f-9e07-933d24cee6c6 req-05e1890c-3104-49a6-bebd-2d26f427c26b service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:47:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-90a62ae9-a87f-484f-9e07-933d24cee6c6 req-05e1890c-3104-49a6-bebd-2d26f427c26b service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-90a62ae9-a87f-484f-9e07-933d24cee6c6 req-05e1890c-3104-49a6-bebd-2d26f427c26b service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-90a62ae9-a87f-484f-9e07-933d24cee6c6 req-05e1890c-3104-49a6-bebd-2d26f427c26b service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:31 user nova-compute[74658]: DEBUG nova.compute.manager [req-90a62ae9-a87f-484f-9e07-933d24cee6c6 req-05e1890c-3104-49a6-bebd-2d26f427c26b service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:47:31 user nova-compute[74658]: WARNING nova.compute.manager [req-90a62ae9-a87f-484f-9e07-933d24cee6c6 req-05e1890c-3104-49a6-bebd-2d26f427c26b service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received unexpected event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with vm_state active and task_state rescuing.
Nov 16 15:47:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:47:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:47:33 user nova-compute[74658]: WARNING nova.compute.manager [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received unexpected event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with vm_state active and task_state rescuing.
Nov 16 15:47:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:47:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:33 user nova-compute[74658]: DEBUG nova.compute.manager [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:47:33 user nova-compute[74658]: WARNING nova.compute.manager [req-2cf4699b-d7a2-4313-b438-0f09b73a3748 req-0b3d646c-8b73-4a35-b700-4de001aff830 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received unexpected event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with vm_state active and task_state rescuing.
Nov 16 15:47:34 user nova-compute[74658]: DEBUG nova.compute.manager [None req-06d63714-0e7b-496e-9f5f-186bd0a6b577 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:36 user nova-compute[74658]: INFO nova.compute.manager [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attaching volume 8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 to /dev/vdb
Nov 16 15:47:36 user nova-compute[74658]: DEBUG os_brick.utils [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9576a09d-0605-46ca-9284-4ea7afc7f815]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f8afff-b823-4c68-b58d-87536613a358]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24afa3c-6b8f-42c0-a49d-e262cb587d6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[545b3993-e44f-4815-b3b6-29b872af17ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:47:36 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:47:36 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caa802c-c6e0-4186-a7c6-d6eee4481cff]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG os_brick.utils [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:47:36 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updating existing volume attachment record: 220723f1-fd68-4f8a-9235-a7267ec8ec3c {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:47:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:38 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhxQEmfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:47:41 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:47:41 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:47:41 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b047ff0b-46e8-45ab-8db9-6ff524bd3c4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:47:41 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff17e66-b439-497a-8f0b-01e89f1e3e69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2] added
Nov 16 15:47:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[97444bdf-89ba-4225-a153-f7b06b71d585]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c02651-dcf9-439a-895c-d1db434c1c75]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FhxQEmfR {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FhxQEmfR" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[561918dd-26bd-44b9-a789-5a1dd5754c63]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FhxQEmfR'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52b4d2d-b33a-43bf-a32b-04dbbdf726a0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4436e534-7af4-4879-8aa8-44f594e6fdde]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:47:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:47:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebafdb40-c014-4ded-9f00-82277b0922d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2, portal: 172.16.0.220,3260]
Nov 16 15:47:41 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2, portal: 172.16.0.220,3260] successful.
Nov 16 15:47:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bef3e7-b121-4d4c-baa8-88a929ad7b9f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebaf2c2-4ead-4b18-aae7-6b55f694d4a0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:47:41 user nova-compute[74658]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 (non-flash)
Nov 16 15:47:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:47:41 user nova-compute[74658]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 (non-flash)
Nov 16 15:47:41 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6ad445-0cfe-48fa-a415-c02b0138cac3]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:47:41 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:47:42 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:47:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhxQEmfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:47:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:47:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26636663966663833', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:47:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636663966663833', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:47:42 user nova-compute[74658]: DEBUG nova.objects.instance [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:47:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:47:42 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:47:42 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:47:42 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:47:42 user nova-compute[74658]:   <serial>8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2</serial>
Nov 16 15:47:42 user nova-compute[74658]: </disk>
Nov 16 15:47:42 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:47:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:47:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:47:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No VIF found with MAC fa:16:3e:ef:fd:8d, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:47:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-b985350f-9553-4240-88fd-37ad3228cf87 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.844s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:47:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:47:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:47:45 user nova-compute[74658]: INFO nova.compute.manager [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Detaching volume 8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2
Nov 16 15:47:45 user nova-compute[74658]: INFO nova.virt.block_device [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attempting to driver detach volume 8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 from mountpoint /dev/vdb
Nov 16 15:47:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Attempting to detach device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:47:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:47:45 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:47:45 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:47:45 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:47:45 user nova-compute[74658]:   <serial>8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2</serial>
Nov 16 15:47:45 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:47:45 user nova-compute[74658]: </disk>
Nov 16 15:47:45 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:47:45 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Successfully detached device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the persistent domain config.
Nov 16 15:47:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dc36262-5767-4282-886a-f16a89472332 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:47:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:47:45 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:47:45 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:47:45 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:47:45 user nova-compute[74658]:   <serial>8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2</serial>
Nov 16 15:47:45 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:47:45 user nova-compute[74658]: </disk>
Nov 16 15:47:45 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:47:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:47:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:47:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:05 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dc36262-5767-4282-886a-f16a89472332 is timed out.
Nov 16 15:48:05 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Successfully detached device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the live domain config.
Nov 16 15:48:05 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:48:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhxQEmfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:48:05 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:48:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:48:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8029b4d-12e3-4948-847f-d1c758009363]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:48:06 user nova-compute[74658]: No targets found.
Nov 16 15:48:06 user nova-compute[74658]: iSNS:
Nov 16 15:48:06 user nova-compute[74658]: No targets found.
Nov 16 15:48:06 user nova-compute[74658]: STATIC:
Nov 16 15:48:06 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97
Nov 16 15:48:06 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:48:06 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:48:06 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2
Nov 16 15:48:06 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:48:06 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:48:06 user nova-compute[74658]: FIRMWARE:
Nov 16 15:48:06 user nova-compute[74658]: No targets found.
Nov 16 15:48:06 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:48:06 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:48:06 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[91741b08-fb67-4bd7-a32f-7f8dc07993b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6141a6f7-4673-4b2f-9205-aa3739b2d503]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:48:06 user nova-compute[74658]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 (non-flash)
Nov 16 15:48:06 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:48:06 user nova-compute[74658]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 (non-flash)
Nov 16 15:48:06 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0733dbfe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4298ee-d7f9-4ea8-97c4-891090c9d6bb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5cfcc5-b78f-4d40-a0fb-97acb5627c62]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f3b524-73a1-430d-83c6-164c493e96c1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[65493182-26d8-4535-bb99-e360e94312c9]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8fafb7-892e-4560-a996-d41fd0d09710]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b16a43-0988-44d2-be9c-dd50f6811bd8]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2, portal: 172.16.0.220,3260]
Nov 16 15:48:06 user nova-compute[74658]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2, portal: 172.16.0.220,3260] successful.
Nov 16 15:48:06 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e56fda3-7fdd-4c59-8f1d-f29c1bba10f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb2d0b-118d-44c6-90f2-e9242991bdec]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== disconnect_volume: return (308ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:48:06 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:48:07 user nova-compute[74658]: DEBUG nova.objects.instance [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:48:07 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-304837ef-e248-455c-a162-15f928e0f939 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.594s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:48:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:48:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-0143af95-a9e0-4674-a273-4b2115e7ef5b req-97d53958-fd10-4cae-bc21-461c7d61967e service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received event network-changed-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-0143af95-a9e0-4674-a273-4b2115e7ef5b req-97d53958-fd10-4cae-bc21-461c7d61967e service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Refreshing instance network info cache due to event network-changed-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0143af95-a9e0-4674-a273-4b2115e7ef5b req-97d53958-fd10-4cae-bc21-461c7d61967e service nova] Acquiring lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0143af95-a9e0-4674-a273-4b2115e7ef5b req-97d53958-fd10-4cae-bc21-461c7d61967e service nova] Acquired lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.network.neutron [req-0143af95-a9e0-4674-a273-4b2115e7ef5b req-97d53958-fd10-4cae-bc21-461c7d61967e service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Refreshing network info cache for port 5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:48:15 user nova-compute[74658]: INFO nova.compute.manager [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Terminating instance
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.compute.manager [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-34faaece-c6d1-4819-8cc7-1d87c19f8e5d req-5c287107-f604-4387-9585-965d13584878 service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received event network-vif-unplugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34faaece-c6d1-4819-8cc7-1d87c19f8e5d req-5c287107-f604-4387-9585-965d13584878 service nova] Acquiring lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34faaece-c6d1-4819-8cc7-1d87c19f8e5d req-5c287107-f604-4387-9585-965d13584878 service nova] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-34faaece-c6d1-4819-8cc7-1d87c19f8e5d req-5c287107-f604-4387-9585-965d13584878 service nova] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-34faaece-c6d1-4819-8cc7-1d87c19f8e5d req-5c287107-f604-4387-9585-965d13584878 service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] No waiting events found dispatching network-vif-unplugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-34faaece-c6d1-4819-8cc7-1d87c19f8e5d req-5c287107-f604-4387-9585-965d13584878 service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received event network-vif-unplugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.network.neutron [req-0143af95-a9e0-4674-a273-4b2115e7ef5b req-97d53958-fd10-4cae-bc21-461c7d61967e service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updated VIF entry in instance network info cache for port 5cce7a91-f7b5-4ef0-9dec-e854d4e9f131. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.network.neutron [req-0143af95-a9e0-4674-a273-4b2115e7ef5b req-97d53958-fd10-4cae-bc21-461c7d61967e service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updating instance_info_cache with network_info: [{"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0143af95-a9e0-4674-a273-4b2115e7ef5b req-97d53958-fd10-4cae-bc21-461c7d61967e service nova] Releasing lock "refresh_cache-710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:48:15 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Instance destroyed successfully.
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.objects.instance [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lazy-loading 'resources' on Instance uuid 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1596668122',display_name='tempest-TestStampPattern-server-1596668122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1596668122',id=44,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5UHoZpKJDn8GfcVJKJm5KCIx1R0uTdUsqdrzokczp8TeYcgl2pdW37FPRBDT68ysXU05V6n60jUJq9dZu0B/LXblR/2xhvonFsogYXOgSV+xpKzQB3pc6+9vdKw3zezw==',key_name='tempest-TestStampPattern-1719290655',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27345ad8a963400c8c489c34b2a01416',ramdisk_id='',reservation_id='r-bishfwj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-740255138',owner_user_name='tempest-TestStampPattern-740255138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:44:23Z,user_data=None,user_id='f8c5ce8d05cb45aaab68f57932c7bcd5',uuid=710f12eb-ebbc-4f39-bee0-53d8e4d6c96e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converting VIF {"id": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "address": "fa:16:3e:1d:5b:41", "network": {"id": "2df96137-e3d3-4ce9-b2c4-744875c3ecfd", "bridge": "br-int", "label": "tempest-TestStampPattern-2000499132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27345ad8a963400c8c489c34b2a01416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cce7a91-f7", "ovs_interfaceid": "5cce7a91-f7b5-4ef0-9dec-e854d4e9f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:5b:41,bridge_name='br-int',has_traffic_filtering=True,id=5cce7a91-f7b5-4ef0-9dec-e854d4e9f131,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cce7a91-f7') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG os_vif [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:5b:41,bridge_name='br-int',has_traffic_filtering=True,id=5cce7a91-f7b5-4ef0-9dec-e854d4e9f131,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cce7a91-f7') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cce7a91-f7, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e55e1e3-e46b-4901-95a5-2fd985d88d34) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:15 user nova-compute[74658]: INFO os_vif [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:5b:41,bridge_name='br-int',has_traffic_filtering=True,id=5cce7a91-f7b5-4ef0-9dec-e854d4e9f131,network=Network(2df96137-e3d3-4ce9-b2c4-744875c3ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cce7a91-f7')
Nov 16 15:48:15 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Deleting instance files /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e_del
Nov 16 15:48:15 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Deletion of /opt/stack/data/nova/instances/710f12eb-ebbc-4f39-bee0-53d8e4d6c96e_del complete
Nov 16 15:48:15 user nova-compute[74658]: INFO nova.compute.manager [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 15:48:15 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:48:15 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:17 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Took 1.26 seconds to deallocate network for instance.
Nov 16 15:48:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-a5399a68-f601-412a-992e-cd28b6127e19 req-974f2e1f-f53b-48ee-98d3-01ffd460461b service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received event network-vif-deleted-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:48:17 user nova-compute[74658]: INFO nova.compute.manager [req-a5399a68-f601-412a-992e-cd28b6127e19 req-974f2e1f-f53b-48ee-98d3-01ffd460461b service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Neutron deleted interface 5cce7a91-f7b5-4ef0-9dec-e854d4e9f131; detaching it from the instance and deleting it from the info cache
Nov 16 15:48:17 user nova-compute[74658]: DEBUG nova.network.neutron [req-a5399a68-f601-412a-992e-cd28b6127e19 req-974f2e1f-f53b-48ee-98d3-01ffd460461b service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-a5399a68-f601-412a-992e-cd28b6127e19 req-974f2e1f-f53b-48ee-98d3-01ffd460461b service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Detach interface failed, port_id=5cce7a91-f7b5-4ef0-9dec-e854d4e9f131, reason: Instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-be4633c2-0b4a-4536-95e2-d657cf99dce4 req-3b3787f3-2f46-46a1-b144-4ad903afacbc service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received event network-vif-plugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-be4633c2-0b4a-4536-95e2-d657cf99dce4 req-3b3787f3-2f46-46a1-b144-4ad903afacbc service nova] Acquiring lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-be4633c2-0b4a-4536-95e2-d657cf99dce4 req-3b3787f3-2f46-46a1-b144-4ad903afacbc service nova] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-be4633c2-0b4a-4536-95e2-d657cf99dce4 req-3b3787f3-2f46-46a1-b144-4ad903afacbc service nova] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:48:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-be4633c2-0b4a-4536-95e2-d657cf99dce4 req-3b3787f3-2f46-46a1-b144-4ad903afacbc service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] No waiting events found dispatching network-vif-plugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:48:17 user nova-compute[74658]: WARNING nova.compute.manager [req-be4633c2-0b4a-4536-95e2-d657cf99dce4 req-3b3787f3-2f46-46a1-b144-4ad903afacbc service nova] [instance: 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e] Received unexpected event network-vif-plugged-5cce7a91-f7b5-4ef0-9dec-e854d4e9f131 for instance with vm_state deleted and task_state None.
Nov 16 15:48:17 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Deleted allocations for instance 710f12eb-ebbc-4f39-bee0-53d8e4d6c96e
Nov 16 15:48:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-3bf0eba7-6c08-40e1-a856-8ce26252cd84 tempest-TestStampPattern-740255138 tempest-TestStampPattern-740255138-project-member] Lock "710f12eb-ebbc-4f39-bee0-53d8e4d6c96e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.531s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:48:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:21 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:48:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:48:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:48:21 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:48:21 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updating instance_info_cache with network_info: [{"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:48:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:48:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:48:21 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:24 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:48:24 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8647MB free_disk=25.182777404785156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 0dc36262-5767-4282-886a-f16a89472332 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance cca2e870-3378-4f24-839c-5655157e8c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 15:48:24 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:48:25 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:48:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:48:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:48:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:48:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:48:28 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:48:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:48:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:48:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:48:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:48:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:48:37 user nova-compute[74658]: INFO nova.compute.manager [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attaching volume 1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 to /dev/vdb
Nov 16 15:48:37 user nova-compute[74658]: DEBUG os_brick.utils [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed550b7e-7070-445d-9c82-164bdc05592b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bc38e9-a643-4243-b1b5-2dfc0510d3c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b698277e-36e6-4d1a-b08c-ddbe46ea3c61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafa254c-f6d6-4420-98f4-a44a5edcd4ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:48:37 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:48:37 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0574138-3042-4d12-9640-e14f19f91a2a]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG os_brick.utils [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:48:37 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updating existing volume attachment record: 748481de-cecf-44fa-a68d-258e05f4292f {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:48:40 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:40 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 15:48:40 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 15:48:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJynSwuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:48:42 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:48:42 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:48:42 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ec13c4-e39e-42f8-86a0-401f75f92ef7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:48:42 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2ec728-ecfa-4164-a5d8-8eec84c56359]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949] added
Nov 16 15:48:42 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef292164-f0b5-4dcf-b979-72f29b77ed27]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7917e5d-a295-4f45-8c70-fd16ecffc583]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJynSwuE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJynSwuE" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41db990-bd64-4e0f-871a-4682f87589d1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IJynSwuE'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd9b781-f749-47ed-8529-827bf5ce423d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4331820-4bfb-4edb-ab5f-b49a3fe9fc75]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:48:42 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:48:42 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fbd15f-a0f1-424f-86f7-4002ee3acd0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949, portal: 172.16.0.220,3260]
Nov 16 15:48:42 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949, portal: 172.16.0.220,3260] successful.
Nov 16 15:48:42 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcb6871-93b4-4870-95d8-2c75f2423d71]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[53887df4-861f-4f98-bad1-189741d17506]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:48:42 user nova-compute[74658]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 (non-flash)
Nov 16 15:48:42 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:48:42 user nova-compute[74658]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 (non-flash)
Nov 16 15:48:42 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac16fee-de0b-4ea0-865a-4d1ca027ec23]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:48:42 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:48:43 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:48:43 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:48:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJynSwuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:48:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:48:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23539323731323366', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:48:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539323731323366', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:48:43 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:48:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:48:43 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:48:43 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:48:43 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:48:43 user nova-compute[74658]:   <serial>1dbc9156-a9d1-4b2c-bcca-ac86d05cd949</serial>
Nov 16 15:48:43 user nova-compute[74658]: </disk>
Nov 16 15:48:43 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:48:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:48:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:48:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No VIF found with MAC fa:16:3e:ef:fd:8d, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:48:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0b89bb9e-8d6b-4571-9b68-dc9b9768ab22 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.719s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:48:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:48:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:48:46 user nova-compute[74658]: INFO nova.compute.manager [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Detaching volume 1dbc9156-a9d1-4b2c-bcca-ac86d05cd949
Nov 16 15:48:46 user nova-compute[74658]: INFO nova.virt.block_device [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attempting to driver detach volume 1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 from mountpoint /dev/vdb
Nov 16 15:48:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Attempting to detach device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:48:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:48:46 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:48:46 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:48:46 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:48:46 user nova-compute[74658]:   <serial>1dbc9156-a9d1-4b2c-bcca-ac86d05cd949</serial>
Nov 16 15:48:46 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:48:46 user nova-compute[74658]: </disk>
Nov 16 15:48:46 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:48:46 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Successfully detached device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the persistent domain config.
Nov 16 15:48:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dc36262-5767-4282-886a-f16a89472332 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:48:46 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:48:46 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:48:46 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:48:46 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:48:46 user nova-compute[74658]:   <serial>1dbc9156-a9d1-4b2c-bcca-ac86d05cd949</serial>
Nov 16 15:48:46 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:48:46 user nova-compute[74658]: </disk>
Nov 16 15:48:46 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:48:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:48:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:48:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:07 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dc36262-5767-4282-886a-f16a89472332 is timed out.
Nov 16 15:49:07 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Successfully detached device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the live domain config.
Nov 16 15:49:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJynSwuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:49:07 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9228701-ed0d-44b4-807d-58b660c4d536]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:49:07 user nova-compute[74658]: No targets found.
Nov 16 15:49:07 user nova-compute[74658]: iSNS:
Nov 16 15:49:07 user nova-compute[74658]: No targets found.
Nov 16 15:49:07 user nova-compute[74658]: STATIC:
Nov 16 15:49:07 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97
Nov 16 15:49:07 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:49:07 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:49:07 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949
Nov 16 15:49:07 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:49:07 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:49:07 user nova-compute[74658]: FIRMWARE:
Nov 16 15:49:07 user nova-compute[74658]: No targets found.
Nov 16 15:49:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:49:07 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:49:07 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce3d52d-4072-4607-bc50-028ee6fe68d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[29190e57-1324-4e75-891f-7b27efce14e5]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:49:07 user nova-compute[74658]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 (non-flash)
Nov 16 15:49:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:49:07 user nova-compute[74658]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 (non-flash)
Nov 16 15:49:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07300ac670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb814261-0796-450b-834b-230d1d1d2c72]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff491bb-6b86-480a-9c7e-9e0a8ea72b58]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0db56-0476-46ed-8aba-4cae5feab9bc]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[364cf03d-74a7-4841-98c7-c063d715c8c3]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[856cbbdf-70b6-4d93-a8e3-1f52d3ec5617]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c29ffe-2568-4509-9eb4-b3ad7062af8b]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949, portal: 172.16.0.220,3260]
Nov 16 15:49:07 user nova-compute[74658]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949, portal: 172.16.0.220,3260] successful.
Nov 16 15:49:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbc9156-a9d1-4b2c-bcca-ac86d05cd949 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f92743-eade-43b6-83ef-436177138d36]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== disconnect_volume: return (326ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:49:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:49:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:08 user nova-compute[74658]: DEBUG nova.objects.instance [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:49:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7ee02168-31f7-478a-b7e9-807e3792c923 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.641s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:49:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:18 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:49:20 user nova-compute[74658]: INFO nova.compute.manager [None req-0423acac-b55c-4711-bd0c-f38d76d5eb12 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Unrescuing
Nov 16 15:49:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0423acac-b55c-4711-bd0c-f38d76d5eb12 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0423acac-b55c-4711-bd0c-f38d76d5eb12 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquired lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0423acac-b55c-4711-bd0c-f38d76d5eb12 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0423acac-b55c-4711-bd0c-f38d76d5eb12 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updating instance_info_cache with network_info: [{"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0423acac-b55c-4711-bd0c-f38d76d5eb12 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Releasing lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0423acac-b55c-4711-bd0c-f38d76d5eb12 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'flavor' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-5cf02262-d8b4-4eb7-8a77-615e46d9eaf5 req-3a0d3336-babc-465d-93e1-f3a65e44d6d7 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-unplugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5cf02262-d8b4-4eb7-8a77-615e46d9eaf5 req-3a0d3336-babc-465d-93e1-f3a65e44d6d7 service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5cf02262-d8b4-4eb7-8a77-615e46d9eaf5 req-3a0d3336-babc-465d-93e1-f3a65e44d6d7 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5cf02262-d8b4-4eb7-8a77-615e46d9eaf5 req-3a0d3336-babc-465d-93e1-f3a65e44d6d7 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:49:20 user nova-compute[74658]: DEBUG nova.compute.manager [req-5cf02262-d8b4-4eb7-8a77-615e46d9eaf5 req-3a0d3336-babc-465d-93e1-f3a65e44d6d7 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-unplugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:49:20 user nova-compute[74658]: WARNING nova.compute.manager [req-5cf02262-d8b4-4eb7-8a77-615e46d9eaf5 req-3a0d3336-babc-465d-93e1-f3a65e44d6d7 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received unexpected event network-vif-unplugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:49:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:21 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:49:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:49:21 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Instance destroyed successfully.
Nov 16 15:49:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:49:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:49:21 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 0dc36262-5767-4282-886a-f16a89472332] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:49:21 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updating instance_info_cache with network_info: [{"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:49:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-0dc36262-5767-4282-886a-f16a89472332" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:49:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:49:22 user nova-compute[74658]: WARNING nova.compute.manager [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received unexpected event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:49:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:49:22 user nova-compute[74658]: WARNING nova.compute.manager [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received unexpected event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:49:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:49:22 user nova-compute[74658]: DEBUG nova.compute.manager [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:49:22 user nova-compute[74658]: WARNING nova.compute.manager [req-28e9e46e-318c-41b7-9c93-6161342209f1 req-95f8f7af-7a1c-4bc8-a827-cb325677b601 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received unexpected event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with vm_state rescued and task_state unrescuing.
Nov 16 15:49:23 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0423acac-b55c-4711-bd0c-f38d76d5eb12 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:49:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:25 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:49:25 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:49:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.172515869140625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 0dc36262-5767-4282-886a-f16a89472332 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance cca2e870-3378-4f24-839c-5655157e8c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:49:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:49:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:49:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:49:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:49:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:49:27 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:49:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:49:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:49:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:49:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:49:38 user nova-compute[74658]: DEBUG nova.objects.instance [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:49:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:49:39 user nova-compute[74658]: INFO nova.compute.manager [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attaching volume af5406d1-2ffa-45e2-8e89-63b4fb9080f4 to /dev/vdb
Nov 16 15:49:39 user nova-compute[74658]: DEBUG os_brick.utils [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[349da50a-8466-4430-9905-3b7077f55323]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6df119-e6c8-4e62-8a12-abc63b1bfbb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae62a79-9be7-4989-ae56-bb770489c746]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce75022-0f7a-446f-8d0c-d987f3280f34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:49:39 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:49:39 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[462158a6-c4bc-44f1-a377-19a5ebbdbf77]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG os_brick.utils [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:49:39 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updating existing volume attachment record: f49e3eac-61bc-47d0-ade9-028652641e2c {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:49:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:49:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:43 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOTVxfCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:49:44 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:49:44 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:49:44 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6139a8-67ca-42ef-96f0-79072e56c601]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:49:44 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90750fe-2bcc-43a6-8279-eb6f08f41e44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4] added
Nov 16 15:49:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed04b1-a65d-42ab-882e-644481d0a39d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47db112-cf80-4772-a5a9-229161112337]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOTVxfCa {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOTVxfCa" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[241695b3-62b9-4416-af9c-44102c8fa3be]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EOTVxfCa'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1ed96b-0239-4c9c-89a6-fec7438839e5]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[008c35da-17b9-427e-9992-d06092bae804]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:49:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:49:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29e419a-e125-4b8f-a6a1-79c7b7ad1dc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4, portal: 172.16.0.220,3260]
Nov 16 15:49:44 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4, portal: 172.16.0.220,3260] successful.
Nov 16 15:49:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7800ad-3282-460f-9e71-7ac428d40c2f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[586f4610-4e1e-4e21-ac61-337b3a5b10a1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:49:44 user nova-compute[74658]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 (non-flash)
Nov 16 15:49:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:49:44 user nova-compute[74658]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 (non-flash)
Nov 16 15:49:44 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04a0da4-e117-4089-a725-634416aea6d6]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:49:44 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:49:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:49:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOTVxfCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:49:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:49:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26437366237636661', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:49:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437366237636661', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:49:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:49:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:49:45 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:49:45 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:49:45 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:49:45 user nova-compute[74658]:   <serial>af5406d1-2ffa-45e2-8e89-63b4fb9080f4</serial>
Nov 16 15:49:45 user nova-compute[74658]: </disk>
Nov 16 15:49:45 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:49:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:49:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:49:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] No VIF found with MAC fa:16:3e:ef:fd:8d, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:49:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-345f971c-8399-4f59-be62-9e2b216ddb2d tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.116s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:49:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:49:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:49:48 user nova-compute[74658]: INFO nova.compute.manager [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Detaching volume af5406d1-2ffa-45e2-8e89-63b4fb9080f4
Nov 16 15:49:48 user nova-compute[74658]: INFO nova.virt.block_device [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Attempting to driver detach volume af5406d1-2ffa-45e2-8e89-63b4fb9080f4 from mountpoint /dev/vdb
Nov 16 15:49:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Attempting to detach device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:49:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:49:48 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:49:48 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:49:48 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:49:48 user nova-compute[74658]:   <serial>af5406d1-2ffa-45e2-8e89-63b4fb9080f4</serial>
Nov 16 15:49:48 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:49:48 user nova-compute[74658]: </disk>
Nov 16 15:49:48 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:49:48 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Successfully detached device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the persistent domain config.
Nov 16 15:49:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dc36262-5767-4282-886a-f16a89472332 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:49:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:49:48 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:49:48 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 15:49:48 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:49:48 user nova-compute[74658]:   <serial>af5406d1-2ffa-45e2-8e89-63b4fb9080f4</serial>
Nov 16 15:49:48 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:49:48 user nova-compute[74658]: </disk>
Nov 16 15:49:48 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:49:48 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:49:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:49:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:08 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dc36262-5767-4282-886a-f16a89472332 is timed out.
Nov 16 15:50:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Successfully detached device vdb from instance 0dc36262-5767-4282-886a-f16a89472332 from the live domain config.
Nov 16 15:50:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOTVxfCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:50:08 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88bce0a-778c-4a75-8c31-7584860d5cb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:50:08 user nova-compute[74658]: No targets found.
Nov 16 15:50:08 user nova-compute[74658]: iSNS:
Nov 16 15:50:08 user nova-compute[74658]: No targets found.
Nov 16 15:50:08 user nova-compute[74658]: STATIC:
Nov 16 15:50:08 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97
Nov 16 15:50:08 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:50:08 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:50:08 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4
Nov 16 15:50:08 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:50:08 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:50:08 user nova-compute[74658]: FIRMWARE:
Nov 16 15:50:08 user nova-compute[74658]: No targets found.
Nov 16 15:50:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:50:08 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:50:08 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6520b936-683b-4c43-bfd8-83efddbdc9f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[108b6367-0110-4e4a-87fe-c8c81e698dfe]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:50:08 user nova-compute[74658]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 (non-flash)
Nov 16 15:50:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:50:08 user nova-compute[74658]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 (non-flash)
Nov 16 15:50:08 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f071038b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbfd868-01e0-48fe-8118-7daf48437cf7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfb71b2-7995-467e-a5b6-34d9cf8714aa]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce6353c-8e84-4586-9513-48a96b26aa3a]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a04fd8a-db65-40b6-9774-e1ed20e88c0d]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a154081c-b736-4b0f-a9e8-7f09c034b4cb]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:50:08 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e734a4-cebb-4c60-837b-0b8d9143a59d]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4, portal: 172.16.0.220,3260]
Nov 16 15:50:09 user nova-compute[74658]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4, portal: 172.16.0.220,3260] successful.
Nov 16 15:50:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5406d1-2ffa-45e2-8e89-63b4fb9080f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f0c05-85d0-494e-9ac9-1aeda69c8e6b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] <== disconnect_volume: return (306ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG nova.objects.instance [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'flavor' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:50:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-92565847-c4dd-4250-9fca-f336f0b1f183 tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.604s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:50:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:50:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:50:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:20 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:50:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:50:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:21 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:50:22 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:50:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:50:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:50:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:50:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:50:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updating instance_info_cache with network_info: [{"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:50:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:50:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:24 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:50:26 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:50:26 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:50:26 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8730MB free_disk=25.170825958251953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 0dc36262-5767-4282-886a-f16a89472332 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance cca2e870-3378-4f24-839c-5655157e8c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:50:26 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:50:28 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:50:28 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:50:28 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:50:28 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:50:28 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:50:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:50:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:50:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:50:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:50:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:50:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:50:54 user nova-compute[74658]: INFO nova.compute.manager [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Terminating instance
Nov 16 15:50:54 user nova-compute[74658]: DEBUG nova.compute.manager [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-58ba2e1f-459e-4feb-989d-61cd0376f3e1 req-9ffe5b71-f6c6-4303-b826-875f42bb0072 service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Received event network-vif-unplugged-05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-58ba2e1f-459e-4feb-989d-61cd0376f3e1 req-9ffe5b71-f6c6-4303-b826-875f42bb0072 service nova] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-58ba2e1f-459e-4feb-989d-61cd0376f3e1 req-9ffe5b71-f6c6-4303-b826-875f42bb0072 service nova] Lock "0dc36262-5767-4282-886a-f16a89472332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-58ba2e1f-459e-4feb-989d-61cd0376f3e1 req-9ffe5b71-f6c6-4303-b826-875f42bb0072 service nova] Lock "0dc36262-5767-4282-886a-f16a89472332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-58ba2e1f-459e-4feb-989d-61cd0376f3e1 req-9ffe5b71-f6c6-4303-b826-875f42bb0072 service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] No waiting events found dispatching network-vif-unplugged-05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-58ba2e1f-459e-4feb-989d-61cd0376f3e1 req-9ffe5b71-f6c6-4303-b826-875f42bb0072 service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Received event network-vif-unplugged-05355b9a-433f-441e-bbcc-3bbfa6348768 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:55 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 0dc36262-5767-4282-886a-f16a89472332] Instance destroyed successfully.
Nov 16 15:50:55 user nova-compute[74658]: DEBUG nova.objects.instance [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lazy-loading 'resources' on Instance uuid 0dc36262-5767-4282-886a-f16a89472332 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:44:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1141095029',display_name='tempest-SnapshotDataIntegrityTests-server-1141095029',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1141095029',id=46,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Al/v42pdlG5+4pNP11AwApUD70i3NVNrDReacM6xW2oouO7jnI0wlDsUphjgczmp93Na9rXKR/3CEtCRFO83Pq0yqN+nN/gB/tWXh8yaMsG0ZBJoj4j7Q4mMTndDcRw==',key_name='tempest-keypair-1052283175',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:44:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='567b17081c594217accb2f14f30e9abb',ramdisk_id='',reservation_id='r-xq3uh1om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1996730971',owner_user_name='tempest-SnapshotDataIntegrityTests-1996730971-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ebcfc6cb72e4a928b909180131604f7',uuid=0dc36262-5767-4282-886a-f16a89472332,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Converting VIF {"id": "05355b9a-433f-441e-bbcc-3bbfa6348768", "address": "fa:16:3e:ef:fd:8d", "network": {"id": "ce3c3b92-55fa-4a58-bcd7-f66d3962a49f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1692184149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567b17081c594217accb2f14f30e9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05355b9a-43", "ovs_interfaceid": "05355b9a-433f-441e-bbcc-3bbfa6348768", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:fd:8d,bridge_name='br-int',has_traffic_filtering=True,id=05355b9a-433f-441e-bbcc-3bbfa6348768,network=Network(ce3c3b92-55fa-4a58-bcd7-f66d3962a49f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05355b9a-43') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG os_vif [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:fd:8d,bridge_name='br-int',has_traffic_filtering=True,id=05355b9a-433f-441e-bbcc-3bbfa6348768,network=Network(ce3c3b92-55fa-4a58-bcd7-f66d3962a49f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05355b9a-43') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05355b9a-43, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d6db0c0-aebf-465a-b2cf-072183b5bdcd) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:50:55 user nova-compute[74658]: INFO os_vif [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:fd:8d,bridge_name='br-int',has_traffic_filtering=True,id=05355b9a-433f-441e-bbcc-3bbfa6348768,network=Network(ce3c3b92-55fa-4a58-bcd7-f66d3962a49f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05355b9a-43')
Nov 16 15:50:55 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Deleting instance files /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332_del
Nov 16 15:50:55 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Deletion of /opt/stack/data/nova/instances/0dc36262-5767-4282-886a-f16a89472332_del complete
Nov 16 15:50:55 user nova-compute[74658]: INFO nova.compute.manager [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] [instance: 0dc36262-5767-4282-886a-f16a89472332] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 15:50:55 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 0dc36262-5767-4282-886a-f16a89472332] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 0dc36262-5767-4282-886a-f16a89472332] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 0dc36262-5767-4282-886a-f16a89472332] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:50:55 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 0dc36262-5767-4282-886a-f16a89472332] Took 0.65 seconds to deallocate network for instance.
Nov 16 15:50:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:50:55 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:50:56 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:50:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:50:56 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Deleted allocations for instance 0dc36262-5767-4282-886a-f16a89472332
Nov 16 15:50:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-2b3a221b-2bd5-4ed5-b874-dac01235260b tempest-SnapshotDataIntegrityTests-1996730971 tempest-SnapshotDataIntegrityTests-1996730971-project-member] Lock "0dc36262-5767-4282-886a-f16a89472332" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.932s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:50:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-823926a9-317f-4ae1-ba06-181f1023dfc0 req-b2d13748-4e15-49d2-9860-814755e9ea65 service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Received event network-vif-plugged-05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:50:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-823926a9-317f-4ae1-ba06-181f1023dfc0 req-b2d13748-4e15-49d2-9860-814755e9ea65 service nova] Acquiring lock "0dc36262-5767-4282-886a-f16a89472332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:50:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-823926a9-317f-4ae1-ba06-181f1023dfc0 req-b2d13748-4e15-49d2-9860-814755e9ea65 service nova] Lock "0dc36262-5767-4282-886a-f16a89472332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:50:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-823926a9-317f-4ae1-ba06-181f1023dfc0 req-b2d13748-4e15-49d2-9860-814755e9ea65 service nova] Lock "0dc36262-5767-4282-886a-f16a89472332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:50:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-823926a9-317f-4ae1-ba06-181f1023dfc0 req-b2d13748-4e15-49d2-9860-814755e9ea65 service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] No waiting events found dispatching network-vif-plugged-05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:50:56 user nova-compute[74658]: WARNING nova.compute.manager [req-823926a9-317f-4ae1-ba06-181f1023dfc0 req-b2d13748-4e15-49d2-9860-814755e9ea65 service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Received unexpected event network-vif-plugged-05355b9a-433f-441e-bbcc-3bbfa6348768 for instance with vm_state deleted and task_state None.
Nov 16 15:50:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-823926a9-317f-4ae1-ba06-181f1023dfc0 req-b2d13748-4e15-49d2-9860-814755e9ea65 service nova] [instance: 0dc36262-5767-4282-886a-f16a89472332] Received event network-vif-deleted-05355b9a-433f-441e-bbcc-3bbfa6348768 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:51:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:51:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:51:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:51:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-85f1f935-1400-40ee-873e-b1d9d15decac req-b783e5cf-90b9-4025-8822-be44156d0e52 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-changed-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:51:11 user nova-compute[74658]: DEBUG nova.compute.manager [req-85f1f935-1400-40ee-873e-b1d9d15decac req-b783e5cf-90b9-4025-8822-be44156d0e52 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Refreshing instance network info cache due to event network-changed-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:51:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-85f1f935-1400-40ee-873e-b1d9d15decac req-b783e5cf-90b9-4025-8822-be44156d0e52 service nova] Acquiring lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:51:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-85f1f935-1400-40ee-873e-b1d9d15decac req-b783e5cf-90b9-4025-8822-be44156d0e52 service nova] Acquired lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:51:11 user nova-compute[74658]: DEBUG nova.network.neutron [req-85f1f935-1400-40ee-873e-b1d9d15decac req-b783e5cf-90b9-4025-8822-be44156d0e52 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Refreshing network info cache for port 28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:51:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:51:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:51:12 user nova-compute[74658]: INFO nova.compute.manager [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Detaching volume 7beab1ee-29da-4570-a9a5-89860c247a97
Nov 16 15:51:12 user nova-compute[74658]: DEBUG nova.network.neutron [req-85f1f935-1400-40ee-873e-b1d9d15decac req-b783e5cf-90b9-4025-8822-be44156d0e52 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updated VIF entry in instance network info cache for port 28e7d197-878a-4e5f-97a0-fa0e1d2feaa2. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:51:12 user nova-compute[74658]: DEBUG nova.network.neutron [req-85f1f935-1400-40ee-873e-b1d9d15decac req-b783e5cf-90b9-4025-8822-be44156d0e52 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updating instance_info_cache with network_info: [{"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:51:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-85f1f935-1400-40ee-873e-b1d9d15decac req-b783e5cf-90b9-4025-8822-be44156d0e52 service nova] Releasing lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:51:12 user nova-compute[74658]: INFO nova.virt.block_device [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Attempting to driver detach volume 7beab1ee-29da-4570-a9a5-89860c247a97 from mountpoint /dev/vdb
Nov 16 15:51:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Attempting to detach device vdb from instance cca2e870-3378-4f24-839c-5655157e8c52 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:51:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:51:12 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:51:12 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:51:12 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:51:12 user nova-compute[74658]:   <serial>7beab1ee-29da-4570-a9a5-89860c247a97</serial>
Nov 16 15:51:12 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:51:12 user nova-compute[74658]: </disk>
Nov 16 15:51:12 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:51:12 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Successfully detached device vdb from instance cca2e870-3378-4f24-839c-5655157e8c52 from the persistent domain config.
Nov 16 15:51:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cca2e870-3378-4f24-839c-5655157e8c52 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:51:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:51:12 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:51:12 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:51:12 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:51:12 user nova-compute[74658]:   <serial>7beab1ee-29da-4570-a9a5-89860c247a97</serial>
Nov 16 15:51:12 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:51:12 user nova-compute[74658]: </disk>
Nov 16 15:51:12 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:51:12 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:51:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-bafda120-88d6-4a74-b7bc-21433f0905ef req-9cf3bb16-a0cf-4ddf-8739-2b528ba685f5 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-changed-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:51:13 user nova-compute[74658]: DEBUG nova.compute.manager [req-bafda120-88d6-4a74-b7bc-21433f0905ef req-9cf3bb16-a0cf-4ddf-8739-2b528ba685f5 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Refreshing instance network info cache due to event network-changed-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:51:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bafda120-88d6-4a74-b7bc-21433f0905ef req-9cf3bb16-a0cf-4ddf-8739-2b528ba685f5 service nova] Acquiring lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:51:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bafda120-88d6-4a74-b7bc-21433f0905ef req-9cf3bb16-a0cf-4ddf-8739-2b528ba685f5 service nova] Acquired lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:51:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-bafda120-88d6-4a74-b7bc-21433f0905ef req-9cf3bb16-a0cf-4ddf-8739-2b528ba685f5 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Refreshing network info cache for port 28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:51:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-bafda120-88d6-4a74-b7bc-21433f0905ef req-9cf3bb16-a0cf-4ddf-8739-2b528ba685f5 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updated VIF entry in instance network info cache for port 28e7d197-878a-4e5f-97a0-fa0e1d2feaa2. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:51:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-bafda120-88d6-4a74-b7bc-21433f0905ef req-9cf3bb16-a0cf-4ddf-8739-2b528ba685f5 service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updating instance_info_cache with network_info: [{"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:51:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bafda120-88d6-4a74-b7bc-21433f0905ef req-9cf3bb16-a0cf-4ddf-8739-2b528ba685f5 service nova] Releasing lock "refresh_cache-cca2e870-3378-4f24-839c-5655157e8c52" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:51:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:51:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:51:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:51:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:51:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:51:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:51:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:51:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:51:22 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:51:22 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:51:24 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:51:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:51:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:51:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:51:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:51:24 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:51:24 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:51:24 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updating instance_info_cache with network_info: [{"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:51:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-82b619d5-e9e6-4e01-83f6-813de238bd5a" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:51:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:25 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:26 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:27 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:51:27 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:51:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=25.19778823852539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:51:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:51:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:51:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:51:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:51:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance cca2e870-3378-4f24-839c-5655157e8c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:51:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:51:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:51:27 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:51:27 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:51:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:51:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:51:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:51:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:51:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:51:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:51:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:51:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:51:32 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cca2e870-3378-4f24-839c-5655157e8c52 is timed out.
Nov 16 15:51:32 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Successfully detached device vdb from instance cca2e870-3378-4f24-839c-5655157e8c52 from the live domain config.
Nov 16 15:51:32 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACYWpMhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:51:32 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c4ca7c-79db-43fc-b4c8-19e9023476ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:51:32 user nova-compute[74658]: No targets found.
Nov 16 15:51:32 user nova-compute[74658]: iSNS:
Nov 16 15:51:32 user nova-compute[74658]: No targets found.
Nov 16 15:51:32 user nova-compute[74658]: STATIC:
Nov 16 15:51:32 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97
Nov 16 15:51:32 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:51:32 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:51:32 user nova-compute[74658]: FIRMWARE:
Nov 16 15:51:32 user nova-compute[74658]: No targets found.
Nov 16 15:51:32 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:51:32 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:51:32 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac3cf89-4153-4448-804c-f52875d729a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e8c579-4adc-406c-b82a-b7175e3291de]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:51:32 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 (non-flash)
Nov 16 15:51:32 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0710100e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[988cf7a9-1ed4-4bf9-b77a-eef7dfdbf5c3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a556fad-81bf-4292-ab27-056a3d4845b7]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc89cded-bdf4-4a9b-8cef-52f2f64885bd]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:51:32 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b0c848-8f44-490e-b157-4650b7e83c43]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee087881-1793-4169-ad87-0519e8d7885e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5346c548-2b90-48ae-ae1a-bdd74c79e490]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97, portal: 172.16.0.220,3260]
Nov 16 15:51:33 user nova-compute[74658]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97, portal: 172.16.0.220,3260] successful.
Nov 16 15:51:33 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7beab1ee-29da-4570-a9a5-89860c247a97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d54b89-1776-4d09-915c-c91eb11c9774]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] <== disconnect_volume: return (296ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG nova.objects.instance [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'flavor' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:51:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1fddab38-231e-42f8-9c10-fd779977e541 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:51:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:51:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:51:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:51:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:51:45 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:51:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:51:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:51:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:51:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:02 user nova-compute[74658]: INFO nova.compute.manager [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Terminating instance
Nov 16 15:52:02 user nova-compute[74658]: DEBUG nova.compute.manager [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-b6470fb6-ee33-4a61-9415-6460966e82dc req-cdc8e576-70fd-49ee-ad40-4048f21a0a0b service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-unplugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b6470fb6-ee33-4a61-9415-6460966e82dc req-cdc8e576-70fd-49ee-ad40-4048f21a0a0b service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b6470fb6-ee33-4a61-9415-6460966e82dc req-cdc8e576-70fd-49ee-ad40-4048f21a0a0b service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-b6470fb6-ee33-4a61-9415-6460966e82dc req-cdc8e576-70fd-49ee-ad40-4048f21a0a0b service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-b6470fb6-ee33-4a61-9415-6460966e82dc req-cdc8e576-70fd-49ee-ad40-4048f21a0a0b service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-unplugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-b6470fb6-ee33-4a61-9415-6460966e82dc req-cdc8e576-70fd-49ee-ad40-4048f21a0a0b service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-unplugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:03 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Instance destroyed successfully.
Nov 16 15:52:03 user nova-compute[74658]: DEBUG nova.objects.instance [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'resources' on Instance uuid cca2e870-3378-4f24-839c-5655157e8c52 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1216046020',display_name='tempest-ServerRescueNegativeTestJSON-server-1216046020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1216046020',id=47,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiRbqkkZZ6oDLl/CvWxCHYdB9Pymo6TQ78DbQptid02AGqsgtX1IXkfOueOfcHF+LDP9erTIjqovfOGgCFkkEkkGNYoDiwKQDZbyXPcW5WM/ouxTcRL0Z4eQEUQFxR6Kg==',key_name='tempest-keypair-929872367',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:47:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-5rjpmfpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a638862f3424fda9cd0a29b76596857',uuid=cca2e870-3378-4f24-839c-5655157e8c52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "address": "fa:16:3e:9b:0a:ca", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7d197-87", "ovs_interfaceid": "28e7d197-878a-4e5f-97a0-fa0e1d2feaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=28e7d197-878a-4e5f-97a0-fa0e1d2feaa2,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7d197-87') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG os_vif [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=28e7d197-878a-4e5f-97a0-fa0e1d2feaa2,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7d197-87') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28e7d197-87, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b48e233-b71a-486e-ad7f-f60eecb2d450) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:52:03 user nova-compute[74658]: INFO os_vif [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=28e7d197-878a-4e5f-97a0-fa0e1d2feaa2,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7d197-87')
Nov 16 15:52:03 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Deleting instance files /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52_del
Nov 16 15:52:03 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Deletion of /opt/stack/data/nova/instances/cca2e870-3378-4f24-839c-5655157e8c52_del complete
Nov 16 15:52:03 user nova-compute[74658]: INFO nova.compute.manager [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 15:52:03 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:52:03 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: cca2e870-3378-4f24-839c-5655157e8c52] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:52:04 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:52:04 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Took 0.95 seconds to deallocate network for instance.
Nov 16 15:52:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:04 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:52:04 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:52:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:04 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Deleted allocations for instance cca2e870-3378-4f24-839c-5655157e8c52
Nov 16 15:52:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-36472e09-bbc0-4bbf-9129-6643e9eb6424 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "cca2e870-3378-4f24-839c-5655157e8c52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.171s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-5f527aaf-2ab0-4079-a532-6448a53a0412 req-2aaa5940-f19c-4701-9a33-ab59ed7cea1f service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:52:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5f527aaf-2ab0-4079-a532-6448a53a0412 req-2aaa5940-f19c-4701-9a33-ab59ed7cea1f service nova] Acquiring lock "cca2e870-3378-4f24-839c-5655157e8c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5f527aaf-2ab0-4079-a532-6448a53a0412 req-2aaa5940-f19c-4701-9a33-ab59ed7cea1f service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5f527aaf-2ab0-4079-a532-6448a53a0412 req-2aaa5940-f19c-4701-9a33-ab59ed7cea1f service nova] Lock "cca2e870-3378-4f24-839c-5655157e8c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-5f527aaf-2ab0-4079-a532-6448a53a0412 req-2aaa5940-f19c-4701-9a33-ab59ed7cea1f service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] No waiting events found dispatching network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:52:04 user nova-compute[74658]: WARNING nova.compute.manager [req-5f527aaf-2ab0-4079-a532-6448a53a0412 req-2aaa5940-f19c-4701-9a33-ab59ed7cea1f service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received unexpected event network-vif-plugged-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 for instance with vm_state deleted and task_state None.
Nov 16 15:52:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-5f527aaf-2ab0-4079-a532-6448a53a0412 req-2aaa5940-f19c-4701-9a33-ab59ed7cea1f service nova] [instance: cca2e870-3378-4f24-839c-5655157e8c52] Received event network-vif-deleted-28e7d197-878a-4e5f-97a0-fa0e1d2feaa2 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:52:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:52:23 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:52:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:24 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:52:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:52:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:52:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:52:24 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:52:24 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updating instance_info_cache with network_info: [{"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:52:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-7ec5f4b8-e749-4121-9206-4e8ddf45981d" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:52:24 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:52:24 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:52:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:52:28 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:52:28 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:52:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8990MB free_disk=25.22445297241211GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:52:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:52:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:52:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:52:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:52:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:52:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:52:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:52:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Verify base images {{(pid=74658) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Image id aca440dd-4b6f-4e54-990c-d8198a375081 yields fingerprint adbba702242cf0ca20cfe480b6995a2b8dff66a2 {{(pid=74658) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 15:52:50 user nova-compute[74658]: INFO nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] image aca440dd-4b6f-4e54-990c-d8198a375081 at (/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2): checking
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] image aca440dd-4b6f-4e54-990c-d8198a375081 at (/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2): image is in use {{(pid=74658) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74658) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] 82b619d5-e9e6-4e01-83f6-813de238bd5a is a valid instance name {{(pid=74658) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] 82b619d5-e9e6-4e01-83f6-813de238bd5a has a disk file {{(pid=74658) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a is backed by adbba702242cf0ca20cfe480b6995a2b8dff66a2 {{(pid=74658) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] 7ec5f4b8-e749-4121-9206-4e8ddf45981d is a valid instance name {{(pid=74658) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] 7ec5f4b8-e749-4121-9206-4e8ddf45981d has a disk file {{(pid=74658) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d is backed by adbba702242cf0ca20cfe480b6995a2b8dff66a2 {{(pid=74658) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 16 15:52:50 user nova-compute[74658]: WARNING nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Unknown base file: /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1
Nov 16 15:52:50 user nova-compute[74658]: WARNING nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Unknown base file: /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a
Nov 16 15:52:50 user nova-compute[74658]: WARNING nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Unknown base file: /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4
Nov 16 15:52:50 user nova-compute[74658]: WARNING nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Unknown base file: /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851
Nov 16 15:52:50 user nova-compute[74658]: WARNING nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Unknown base file: /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046
Nov 16 15:52:50 user nova-compute[74658]: WARNING nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Unknown base file: /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab
Nov 16 15:52:50 user nova-compute[74658]: WARNING nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Unknown base file: /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746
Nov 16 15:52:50 user nova-compute[74658]: WARNING nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Unknown base file: /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e
Nov 16 15:52:50 user nova-compute[74658]: INFO nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Active base files: /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2
Nov 16 15:52:50 user nova-compute[74658]: INFO nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Removable base files: /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1 /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4 /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851 /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046 /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746 /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e
Nov 16 15:52:50 user nova-compute[74658]: INFO nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1906f4e1a94514a12cc51b07ebb1b8b3c964c3c1
Nov 16 15:52:50 user nova-compute[74658]: INFO nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6ca692ecb222ae5d5d80f8de4f275eab558b4e7a
Nov 16 15:52:50 user nova-compute[74658]: INFO nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bb6ecafd2525826c9fb07902949999d5b3c272c4
Nov 16 15:52:50 user nova-compute[74658]: INFO nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c9839444d257fd6dee8cc1491dc84c23a9a04851
Nov 16 15:52:50 user nova-compute[74658]: INFO nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/772c045860ed51f4d5b13c3290cbb5bbf59ed046
Nov 16 15:52:50 user nova-compute[74658]: INFO nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/34afd04a9395ddcc06deb67b312181602effe9ab
Nov 16 15:52:50 user nova-compute[74658]: INFO nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4946f418f2ef3366aed0cb46203973ab82f3e746
Nov 16 15:52:50 user nova-compute[74658]: INFO nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0aa04802cdee4f6cdc2e6288816dbdad50a6c30e
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Verification complete {{(pid=74658) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Verify swap images {{(pid=74658) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 16 15:52:50 user nova-compute[74658]: DEBUG nova.virt.libvirt.imagecache [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Verify ephemeral images {{(pid=74658) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 16 15:52:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:58 user nova-compute[74658]: INFO nova.compute.manager [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Terminating instance
Nov 16 15:52:58 user nova-compute[74658]: DEBUG nova.compute.manager [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-a7579aa2-2c75-4848-ac06-d4e17d18c652 req-1c415bdf-89ea-4fa3-a2fb-c1c04ccb5bcc service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received event network-vif-unplugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a7579aa2-2c75-4848-ac06-d4e17d18c652 req-1c415bdf-89ea-4fa3-a2fb-c1c04ccb5bcc service nova] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a7579aa2-2c75-4848-ac06-d4e17d18c652 req-1c415bdf-89ea-4fa3-a2fb-c1c04ccb5bcc service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a7579aa2-2c75-4848-ac06-d4e17d18c652 req-1c415bdf-89ea-4fa3-a2fb-c1c04ccb5bcc service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-a7579aa2-2c75-4848-ac06-d4e17d18c652 req-1c415bdf-89ea-4fa3-a2fb-c1c04ccb5bcc service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] No waiting events found dispatching network-vif-unplugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-a7579aa2-2c75-4848-ac06-d4e17d18c652 req-1c415bdf-89ea-4fa3-a2fb-c1c04ccb5bcc service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received event network-vif-unplugged-ff0bce81-b59f-40d5-a192-d0761ba5709b for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:52:58 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Instance destroyed successfully.
Nov 16 15:52:58 user nova-compute[74658]: DEBUG nova.objects.instance [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'resources' on Instance uuid 7ec5f4b8-e749-4121-9206-4e8ddf45981d {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1366088746',display_name='tempest-ServerRescueNegativeTestJSON-server-1366088746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1366088746',id=40,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:38:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-s7spn2os',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:38:56Z,user_data=None,user_id='9a638862f3424fda9cd0a29b76596857',uuid=7ec5f4b8-e749-4121-9206-4e8ddf45981d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "address": "fa:16:3e:eb:c3:f5", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0bce81-b5", "ovs_interfaceid": "ff0bce81-b59f-40d5-a192-d0761ba5709b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:c3:f5,bridge_name='br-int',has_traffic_filtering=True,id=ff0bce81-b59f-40d5-a192-d0761ba5709b,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0bce81-b5') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG os_vif [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:c3:f5,bridge_name='br-int',has_traffic_filtering=True,id=ff0bce81-b59f-40d5-a192-d0761ba5709b,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0bce81-b5') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff0bce81-b5, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cb408dd-0424-4a9e-a2d8-8bebc5a65e13) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:52:58 user nova-compute[74658]: INFO os_vif [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:c3:f5,bridge_name='br-int',has_traffic_filtering=True,id=ff0bce81-b59f-40d5-a192-d0761ba5709b,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0bce81-b5')
Nov 16 15:52:58 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Deleting instance files /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d_del
Nov 16 15:52:58 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Deletion of /opt/stack/data/nova/instances/7ec5f4b8-e749-4121-9206-4e8ddf45981d_del complete
Nov 16 15:52:58 user nova-compute[74658]: INFO nova.compute.manager [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 15:52:58 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:52:58 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:52:59 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:52:59 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Took 0.44 seconds to deallocate network for instance.
Nov 16 15:52:59 user nova-compute[74658]: DEBUG nova.compute.manager [req-08cc4424-d2d2-4d10-b6dc-e3033dace83c req-48b539ef-c8ce-429c-906b-8fb9221db16a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received event network-vif-deleted-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:52:59 user nova-compute[74658]: INFO nova.compute.manager [req-08cc4424-d2d2-4d10-b6dc-e3033dace83c req-48b539ef-c8ce-429c-906b-8fb9221db16a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Neutron deleted interface ff0bce81-b59f-40d5-a192-d0761ba5709b; detaching it from the instance and deleting it from the info cache
Nov 16 15:52:59 user nova-compute[74658]: DEBUG nova.network.neutron [req-08cc4424-d2d2-4d10-b6dc-e3033dace83c req-48b539ef-c8ce-429c-906b-8fb9221db16a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:52:59 user nova-compute[74658]: DEBUG nova.compute.manager [req-08cc4424-d2d2-4d10-b6dc-e3033dace83c req-48b539ef-c8ce-429c-906b-8fb9221db16a service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Detach interface failed, port_id=ff0bce81-b59f-40d5-a192-d0761ba5709b, reason: Instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:52:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:52:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:52:59 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:52:59 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:52:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:52:59 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Deleted allocations for instance 7ec5f4b8-e749-4121-9206-4e8ddf45981d
Nov 16 15:52:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-758f4656-f7b5-4afb-a251-54d15aa37b71 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.640s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-e42eb6b5-cfb2-4715-8f35-6f8bedde366a req-c788d5a8-514f-4bb6-be01-bb9b3addf704 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:53:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e42eb6b5-cfb2-4715-8f35-6f8bedde366a req-c788d5a8-514f-4bb6-be01-bb9b3addf704 service nova] Acquiring lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e42eb6b5-cfb2-4715-8f35-6f8bedde366a req-c788d5a8-514f-4bb6-be01-bb9b3addf704 service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e42eb6b5-cfb2-4715-8f35-6f8bedde366a req-c788d5a8-514f-4bb6-be01-bb9b3addf704 service nova] Lock "7ec5f4b8-e749-4121-9206-4e8ddf45981d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-e42eb6b5-cfb2-4715-8f35-6f8bedde366a req-c788d5a8-514f-4bb6-be01-bb9b3addf704 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] No waiting events found dispatching network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:53:00 user nova-compute[74658]: WARNING nova.compute.manager [req-e42eb6b5-cfb2-4715-8f35-6f8bedde366a req-c788d5a8-514f-4bb6-be01-bb9b3addf704 service nova] [instance: 7ec5f4b8-e749-4121-9206-4e8ddf45981d] Received unexpected event network-vif-plugged-ff0bce81-b59f-40d5-a192-d0761ba5709b for instance with vm_state deleted and task_state None.
Nov 16 15:53:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:24 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:24 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:53:26 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 15:53:27 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:53:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:53:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:53:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:53:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:53:28 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:53:28 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9082MB free_disk=25.251907348632812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:53:32 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 15:53:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:48 user nova-compute[74658]: INFO nova.compute.manager [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Terminating instance
Nov 16 15:53:48 user nova-compute[74658]: DEBUG nova.compute.manager [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-4c789b04-4938-49dc-927b-21b2a1e1d2a3 req-e16a8d1d-830f-4538-851b-9df302ef498c service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4c789b04-4938-49dc-927b-21b2a1e1d2a3 req-e16a8d1d-830f-4538-851b-9df302ef498c service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4c789b04-4938-49dc-927b-21b2a1e1d2a3 req-e16a8d1d-830f-4538-851b-9df302ef498c service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4c789b04-4938-49dc-927b-21b2a1e1d2a3 req-e16a8d1d-830f-4538-851b-9df302ef498c service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-4c789b04-4938-49dc-927b-21b2a1e1d2a3 req-e16a8d1d-830f-4538-851b-9df302ef498c service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:53:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-4c789b04-4938-49dc-927b-21b2a1e1d2a3 req-e16a8d1d-830f-4538-851b-9df302ef498c service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:49 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Instance destroyed successfully.
Nov 16 15:53:49 user nova-compute[74658]: DEBUG nova.objects.instance [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lazy-loading 'resources' on Instance uuid 82b619d5-e9e6-4e01-83f6-813de238bd5a {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-120537023',display_name='tempest-ServerRescueNegativeTestJSON-server-120537023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-120537023',id=39,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:41:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681f27eda6c74c20be18669837ace195',ramdisk_id='',reservation_id='r-0q0axze3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1957488214',owner_user_name='tempest-ServerRescueNegativeTestJSON-1957488214-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:43:40Z,user_data=None,user_id='9a638862f3424fda9cd0a29b76596857',uuid=82b619d5-e9e6-4e01-83f6-813de238bd5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converting VIF {"id": "2b2a7adb-93ed-409e-af90-6c594f623c07", "address": "fa:16:3e:a3:5d:6c", "network": {"id": "302ef813-c2d3-4cf4-a0b9-be9ea56ead5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1935475293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681f27eda6c74c20be18669837ace195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2a7adb-93", "ovs_interfaceid": "2b2a7adb-93ed-409e-af90-6c594f623c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:5d:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b2a7adb-93ed-409e-af90-6c594f623c07,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2a7adb-93') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG os_vif [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:5d:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b2a7adb-93ed-409e-af90-6c594f623c07,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2a7adb-93') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b2a7adb-93, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9790a61a-c18d-4a73-b1c6-c00780fdd86e) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:53:49 user nova-compute[74658]: INFO os_vif [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:5d:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b2a7adb-93ed-409e-af90-6c594f623c07,network=Network(302ef813-c2d3-4cf4-a0b9-be9ea56ead5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2a7adb-93')
Nov 16 15:53:49 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Deleting instance files /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a_del
Nov 16 15:53:49 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Deletion of /opt/stack/data/nova/instances/82b619d5-e9e6-4e01-83f6-813de238bd5a_del complete
Nov 16 15:53:49 user nova-compute[74658]: INFO nova.compute.manager [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 15:53:49 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:53:50 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Took 0.49 seconds to deallocate network for instance.
Nov 16 15:53:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-ca506011-e0fa-4e36-9674-cbeb849674dc req-2d46cded-7a1a-4743-9bac-6ecec0f46251 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-deleted-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:53:50 user nova-compute[74658]: INFO nova.compute.manager [req-ca506011-e0fa-4e36-9674-cbeb849674dc req-2d46cded-7a1a-4743-9bac-6ecec0f46251 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Neutron deleted interface 2b2a7adb-93ed-409e-af90-6c594f623c07; detaching it from the instance and deleting it from the info cache
Nov 16 15:53:50 user nova-compute[74658]: DEBUG nova.network.neutron [req-ca506011-e0fa-4e36-9674-cbeb849674dc req-2d46cded-7a1a-4743-9bac-6ecec0f46251 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG nova.compute.manager [req-ca506011-e0fa-4e36-9674-cbeb849674dc req-2d46cded-7a1a-4743-9bac-6ecec0f46251 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Detach interface failed, port_id=2b2a7adb-93ed-409e-af90-6c594f623c07, reason: Instance 82b619d5-e9e6-4e01-83f6-813de238bd5a could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 15:53:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:50 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Deleted allocations for instance 82b619d5-e9e6-4e01-83f6-813de238bd5a
Nov 16 15:53:50 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-70ecb672-de11-425a-901b-87aad24d7714 tempest-ServerRescueNegativeTestJSON-1957488214 tempest-ServerRescueNegativeTestJSON-1957488214-project-member] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.734s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:53:51 user nova-compute[74658]: WARNING nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state deleted and task_state None.
Nov 16 15:53:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:53:51 user nova-compute[74658]: WARNING nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state deleted and task_state None.
Nov 16 15:53:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:53:51 user nova-compute[74658]: WARNING nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state deleted and task_state None.
Nov 16 15:53:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:53:51 user nova-compute[74658]: WARNING nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-unplugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state deleted and task_state None.
Nov 16 15:53:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Acquiring lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] Lock "82b619d5-e9e6-4e01-83f6-813de238bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:53:51 user nova-compute[74658]: DEBUG nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] No waiting events found dispatching network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:53:51 user nova-compute[74658]: WARNING nova.compute.manager [req-bc7ecd2f-ab41-4e87-99cc-5c50c92b0f99 req-0bf543a1-b075-41b4-8fbc-35b33f5eeae3 service nova] [instance: 82b619d5-e9e6-4e01-83f6-813de238bd5a] Received unexpected event network-vif-plugged-2b2a7adb-93ed-409e-af90-6c594f623c07 for instance with vm_state deleted and task_state None.
Nov 16 15:53:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:53:56 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:53:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:54:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_power_states {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:54:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:54:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:54:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:54:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:54:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:54:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:54:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:54:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:54:25 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:54:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:54:27 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:54:27 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:54:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9195MB free_disk=25.279327392578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:54:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:54:28 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:54:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:54:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:54:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:54:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:54:34 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:54:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:54:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:54:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:54:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:54:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:54:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "470b727f-9673-4d82-8b56-6b52bfe302c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:54:51 user nova-compute[74658]: INFO nova.compute.claims [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Claim successful on node user
Nov 16 15:54:51 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:54:51 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:54:51 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG nova.policy [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b3fb6a56c5847ff8ae46e06544158c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f416cd7c5b4496d8bbf1ee6dad85058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:54:51 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Creating image(s)
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "/opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "/opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "/opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:54:51 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk 1073741824" returned: 0 in 0.059s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Successfully created port: 210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.193s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Cannot resize image /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Ensure instance console log exists: /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Successfully updated port: 210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquired lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-456ba1d1-cb55-48c6-b040-52e80ea74d10 req-1d5eb57a-ee26-436f-9e97-94896032995b service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Received event network-changed-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG nova.compute.manager [req-456ba1d1-cb55-48c6-b040-52e80ea74d10 req-1d5eb57a-ee26-436f-9e97-94896032995b service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Refreshing instance network info cache due to event network-changed-210dc1ec-a0ef-44c5-b7ba-07f736dd5406. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:54:52 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-456ba1d1-cb55-48c6-b040-52e80ea74d10 req-1d5eb57a-ee26-436f-9e97-94896032995b service nova] Acquiring lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.network.neutron [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updating instance_info_cache with network_info: [{"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Releasing lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Instance network_info: |[{"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-456ba1d1-cb55-48c6-b040-52e80ea74d10 req-1d5eb57a-ee26-436f-9e97-94896032995b service nova] Acquired lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.network.neutron [req-456ba1d1-cb55-48c6-b040-52e80ea74d10 req-1d5eb57a-ee26-436f-9e97-94896032995b service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Refreshing network info cache for port 210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Start _get_guest_xml network_info=[{"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:54:53 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:54:53 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-4931998',display_name='tempest-AttachVolumeNegativeTest-server-4931998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-4931998',id=48,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDOSLvPd21UmD+7ihlVv9B8pohhlqiqulQ3EMBAu604w0NDKfhKrf7cHN863oIlCJ2EQdzVIHnCTvgePGA7UCSKOkNhw6wBDfbnP/U/defZ7jA+cpij+L1EPEM5Uj8CHQ==',key_name='tempest-keypair-324519684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-h9ktpbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=470b727f-9673-4d82-8b56-6b52bfe302c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:5a,bridge_name='br-int',has_traffic_filtering=True,id=210dc1ec-a0ef-44c5-b7ba-07f736dd5406,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210dc1ec-a0') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.objects.instance [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'pci_devices' on Instance uuid 470b727f-9673-4d82-8b56-6b52bfe302c5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:54:53 user nova-compute[74658]:   <uuid>470b727f-9673-4d82-8b56-6b52bfe302c5</uuid>
Nov 16 15:54:53 user nova-compute[74658]:   <name>instance-00000030</name>
Nov 16 15:54:53 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:54:53 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:54:53 user nova-compute[74658]:   <metadata>
Nov 16 15:54:53 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:54:53 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:54:53 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeNegativeTest-server-4931998</nova:name>
Nov 16 15:54:53 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:54:53</nova:creationTime>
Nov 16 15:54:53 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:54:53 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:54:53 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:54:53 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:54:53 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:54:53 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:54:53 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:54:53 user nova-compute[74658]:       <nova:owner>
Nov 16 15:54:53 user nova-compute[74658]:         <nova:user uuid="2b3fb6a56c5847ff8ae46e06544158c7">tempest-AttachVolumeNegativeTest-1769018240-project-member</nova:user>
Nov 16 15:54:53 user nova-compute[74658]:         <nova:project uuid="6f416cd7c5b4496d8bbf1ee6dad85058">tempest-AttachVolumeNegativeTest-1769018240</nova:project>
Nov 16 15:54:53 user nova-compute[74658]:       </nova:owner>
Nov 16 15:54:53 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:54:53 user nova-compute[74658]:       <nova:ports>
Nov 16 15:54:53 user nova-compute[74658]:         <nova:port uuid="210dc1ec-a0ef-44c5-b7ba-07f736dd5406">
Nov 16 15:54:53 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 15:54:53 user nova-compute[74658]:         </nova:port>
Nov 16 15:54:53 user nova-compute[74658]:       </nova:ports>
Nov 16 15:54:53 user nova-compute[74658]:     </nova:instance>
Nov 16 15:54:53 user nova-compute[74658]:   </metadata>
Nov 16 15:54:53 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:54:53 user nova-compute[74658]:     <system>
Nov 16 15:54:53 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:54:53 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:54:53 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:54:53 user nova-compute[74658]:       <entry name="serial">470b727f-9673-4d82-8b56-6b52bfe302c5</entry>
Nov 16 15:54:53 user nova-compute[74658]:       <entry name="uuid">470b727f-9673-4d82-8b56-6b52bfe302c5</entry>
Nov 16 15:54:53 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:54:53 user nova-compute[74658]:     </system>
Nov 16 15:54:53 user nova-compute[74658]:   </sysinfo>
Nov 16 15:54:53 user nova-compute[74658]:   <os>
Nov 16 15:54:53 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:54:53 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:54:53 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:54:53 user nova-compute[74658]:   </os>
Nov 16 15:54:53 user nova-compute[74658]:   <features>
Nov 16 15:54:53 user nova-compute[74658]:     <acpi/>
Nov 16 15:54:53 user nova-compute[74658]:     <apic/>
Nov 16 15:54:53 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:54:53 user nova-compute[74658]:   </features>
Nov 16 15:54:53 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:54:53 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:54:53 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:54:53 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:54:53 user nova-compute[74658]:   </clock>
Nov 16 15:54:53 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:54:53 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:54:53 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:54:53 user nova-compute[74658]:   </cpu>
Nov 16 15:54:53 user nova-compute[74658]:   <devices>
Nov 16 15:54:53 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:54:53 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:54:53 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk"/>
Nov 16 15:54:53 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:54:53 user nova-compute[74658]:     </disk>
Nov 16 15:54:53 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:54:53 user nova-compute[74658]:       <mac address="fa:16:3e:d7:72:5a"/>
Nov 16 15:54:53 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:54:53 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:54:53 user nova-compute[74658]:       <target dev="tap210dc1ec-a0"/>
Nov 16 15:54:53 user nova-compute[74658]:     </interface>
Nov 16 15:54:53 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:54:53 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/console.log" append="off"/>
Nov 16 15:54:53 user nova-compute[74658]:     </serial>
Nov 16 15:54:53 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:54:53 user nova-compute[74658]:     <video>
Nov 16 15:54:53 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:54:53 user nova-compute[74658]:     </video>
Nov 16 15:54:53 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:54:53 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:54:53 user nova-compute[74658]:     </rng>
Nov 16 15:54:53 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:54:53 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:54:53 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:54:53 user nova-compute[74658]:     </memballoon>
Nov 16 15:54:53 user nova-compute[74658]:   </devices>
Nov 16 15:54:53 user nova-compute[74658]: </domain>
Nov 16 15:54:53 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-4931998',display_name='tempest-AttachVolumeNegativeTest-server-4931998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-4931998',id=48,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDOSLvPd21UmD+7ihlVv9B8pohhlqiqulQ3EMBAu604w0NDKfhKrf7cHN863oIlCJ2EQdzVIHnCTvgePGA7UCSKOkNhw6wBDfbnP/U/defZ7jA+cpij+L1EPEM5Uj8CHQ==',key_name='tempest-keypair-324519684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-h9ktpbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=470b727f-9673-4d82-8b56-6b52bfe302c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:5a,bridge_name='br-int',has_traffic_filtering=True,id=210dc1ec-a0ef-44c5-b7ba-07f736dd5406,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210dc1ec-a0') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG os_vif [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:5a,bridge_name='br-int',has_traffic_filtering=True,id=210dc1ec-a0ef-44c5-b7ba-07f736dd5406,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210dc1ec-a0') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cab8504c-1d74-529d-a2ae-cbf59dad8528', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap210dc1ec-a0, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap210dc1ec-a0, col_values=(('qos', UUID('daa6d316-d5a4-4523-a4f3-8745e1ce7b00')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap210dc1ec-a0, col_values=(('external_ids', {'iface-id': '210dc1ec-a0ef-44c5-b7ba-07f736dd5406', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:72:5a', 'vm-uuid': '470b727f-9673-4d82-8b56-6b52bfe302c5'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:53 user nova-compute[74658]: INFO os_vif [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:5a,bridge_name='br-int',has_traffic_filtering=True,id=210dc1ec-a0ef-44c5-b7ba-07f736dd5406,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210dc1ec-a0')
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No VIF found with MAC fa:16:3e:d7:72:5a, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.network.neutron [req-456ba1d1-cb55-48c6-b040-52e80ea74d10 req-1d5eb57a-ee26-436f-9e97-94896032995b service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updated VIF entry in instance network info cache for port 210dc1ec-a0ef-44c5-b7ba-07f736dd5406. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG nova.network.neutron [req-456ba1d1-cb55-48c6-b040-52e80ea74d10 req-1d5eb57a-ee26-436f-9e97-94896032995b service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updating instance_info_cache with network_info: [{"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:54:53 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-456ba1d1-cb55-48c6-b040-52e80ea74d10 req-1d5eb57a-ee26-436f-9e97-94896032995b service nova] Releasing lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:54:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-2116eb97-e1b4-4a2a-9bb2-8fa6f857a4f2 req-0396efd1-a010-4841-b0f5-c7c1f0d8224d service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Received event network-vif-plugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:54:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2116eb97-e1b4-4a2a-9bb2-8fa6f857a4f2 req-0396efd1-a010-4841-b0f5-c7c1f0d8224d service nova] Acquiring lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:54:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2116eb97-e1b4-4a2a-9bb2-8fa6f857a4f2 req-0396efd1-a010-4841-b0f5-c7c1f0d8224d service nova] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:54:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2116eb97-e1b4-4a2a-9bb2-8fa6f857a4f2 req-0396efd1-a010-4841-b0f5-c7c1f0d8224d service nova] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:54:54 user nova-compute[74658]: DEBUG nova.compute.manager [req-2116eb97-e1b4-4a2a-9bb2-8fa6f857a4f2 req-0396efd1-a010-4841-b0f5-c7c1f0d8224d service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] No waiting events found dispatching network-vif-plugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:54:54 user nova-compute[74658]: WARNING nova.compute.manager [req-2116eb97-e1b4-4a2a-9bb2-8fa6f857a4f2 req-0396efd1-a010-4841-b0f5-c7c1f0d8224d service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Received unexpected event network-vif-plugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 for instance with vm_state building and task_state spawning.
Nov 16 15:54:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:54:56 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Instance spawned successfully.
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-e54d6b04-b206-4373-954a-28c0dc8b6b82 req-c16dd792-1ed8-4d12-a0f4-397a4918c1d2 service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Received event network-vif-plugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e54d6b04-b206-4373-954a-28c0dc8b6b82 req-c16dd792-1ed8-4d12-a0f4-397a4918c1d2 service nova] Acquiring lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e54d6b04-b206-4373-954a-28c0dc8b6b82 req-c16dd792-1ed8-4d12-a0f4-397a4918c1d2 service nova] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e54d6b04-b206-4373-954a-28c0dc8b6b82 req-c16dd792-1ed8-4d12-a0f4-397a4918c1d2 service nova] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-e54d6b04-b206-4373-954a-28c0dc8b6b82 req-c16dd792-1ed8-4d12-a0f4-397a4918c1d2 service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] No waiting events found dispatching network-vif-plugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:54:56 user nova-compute[74658]: WARNING nova.compute.manager [req-e54d6b04-b206-4373-954a-28c0dc8b6b82 req-c16dd792-1ed8-4d12-a0f4-397a4918c1d2 service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Received unexpected event network-vif-plugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 for instance with vm_state building and task_state spawning.
Nov 16 15:54:56 user nova-compute[74658]: INFO nova.compute.manager [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 16 15:54:56 user nova-compute[74658]: DEBUG nova.compute.manager [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:54:57 user nova-compute[74658]: INFO nova.compute.manager [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Took 5.77 seconds to build instance.
Nov 16 15:54:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-c99b2158-a923-46b0-b812-4c0595986653 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.900s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:54:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:55:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:55:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:55:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:55:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:25 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:55:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:27 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:55:27 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:55:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:55:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:55:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:55:27 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:55:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:55:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:55:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:55:27 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:55:28 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:55:28 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:55:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9114MB free_disk=25.24130630493164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:55:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:55:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:55:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 470b727f-9673-4d82-8b56-6b52bfe302c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:55:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:55:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:55:28 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:55:28 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:55:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:55:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:55:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 470b727f-9673-4d82-8b56-6b52bfe302c5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updating instance_info_cache with network_info: [{"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:55:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:55:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:55:31 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:55:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:55:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:55:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:55:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:55:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:55:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:55:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:55:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:55:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:55:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:55:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:55:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:55:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:55:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:51 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:55:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:55:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:55:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:55:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:55:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:55:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:55:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:55:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:55:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:55:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:55:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:56:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:56:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:56:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:56:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:56:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:56:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:56:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:56:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:56:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:56:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:56:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:56:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:56:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:56:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:56:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:56:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:56:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:56:27 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:56:28 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:56:28 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:56:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:56:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:56:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:56:28 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:56:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:28 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:29 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:56:29 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:56:29 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9101MB free_disk=25.240760803222656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:56:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:56:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:56:29 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 470b727f-9673-4d82-8b56-6b52bfe302c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:56:29 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:56:29 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:56:29 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:56:29 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:56:29 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:56:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:56:30 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:56:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:56:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:56:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:56:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:56:30 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:56:30 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 470b727f-9673-4d82-8b56-6b52bfe302c5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:56:30 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updating instance_info_cache with network_info: [{"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:56:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:56:30 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:56:30 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:56:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:56:31 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:56:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:56:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:56:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:56:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:56:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:56:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:56:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-1a3df38d-52f6-44ae-b770-fc67ccfe4303 req-bc5e3120-2914-4e3b-bc5f-95fbe1c6fa7f service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Received event network-changed-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:56:42 user nova-compute[74658]: DEBUG nova.compute.manager [req-1a3df38d-52f6-44ae-b770-fc67ccfe4303 req-bc5e3120-2914-4e3b-bc5f-95fbe1c6fa7f service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Refreshing instance network info cache due to event network-changed-210dc1ec-a0ef-44c5-b7ba-07f736dd5406. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:56:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1a3df38d-52f6-44ae-b770-fc67ccfe4303 req-bc5e3120-2914-4e3b-bc5f-95fbe1c6fa7f service nova] Acquiring lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:56:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1a3df38d-52f6-44ae-b770-fc67ccfe4303 req-bc5e3120-2914-4e3b-bc5f-95fbe1c6fa7f service nova] Acquired lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:56:42 user nova-compute[74658]: DEBUG nova.network.neutron [req-1a3df38d-52f6-44ae-b770-fc67ccfe4303 req-bc5e3120-2914-4e3b-bc5f-95fbe1c6fa7f service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Refreshing network info cache for port 210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:56:42 user nova-compute[74658]: DEBUG nova.network.neutron [req-1a3df38d-52f6-44ae-b770-fc67ccfe4303 req-bc5e3120-2914-4e3b-bc5f-95fbe1c6fa7f service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updated VIF entry in instance network info cache for port 210dc1ec-a0ef-44c5-b7ba-07f736dd5406. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:56:42 user nova-compute[74658]: DEBUG nova.network.neutron [req-1a3df38d-52f6-44ae-b770-fc67ccfe4303 req-bc5e3120-2914-4e3b-bc5f-95fbe1c6fa7f service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updating instance_info_cache with network_info: [{"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:56:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1a3df38d-52f6-44ae-b770-fc67ccfe4303 req-bc5e3120-2914-4e3b-bc5f-95fbe1c6fa7f service nova] Releasing lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:56:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:56:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "470b727f-9673-4d82-8b56-6b52bfe302c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:56:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:56:44 user nova-compute[74658]: DEBUG nova.objects.instance [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'flavor' on Instance uuid 470b727f-9673-4d82-8b56-6b52bfe302c5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:56:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "470b727f-9673-4d82-8b56-6b52bfe302c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:56:45 user nova-compute[74658]: INFO nova.compute.manager [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Attaching volume b416c7c8-120f-4d6f-acac-19184de8572d to /dev/vdb
Nov 16 15:56:45 user nova-compute[74658]: DEBUG os_brick.utils [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc968ca-32f3-466c-8a17-f0eda00fe372]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f12ef9-ec86-432b-bbba-67d9d8151059]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d608760-fcdc-4af1-9301-19c30a4eb1cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5379eeec-84bc-4a66-8c42-19d155eced8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 15:56:45 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 15:56:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb2c856-db77-4c7d-ae18-d0aae968a652]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG os_brick.utils [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:56:45 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updating existing volume attachment record: 3a257f78-e212-4854-822b-d5b2b74ae00d {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 15:56:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeSQNVTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:56:49 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:56:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:56:49 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:56:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:56:49 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 15:56:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b93edc5-5215-45fa-a336-0f01379a286c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 15:56:49 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2127edae-a1a7-4593-b5f2-f03d928ae5dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d] added
Nov 16 15:56:49 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:56:49 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f64361-798b-4683-a07d-6abd3ef65788]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d7f431-25d3-44e7-be34-abd6e3c84e0d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeSQNVTs {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeSQNVTs" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[21496cfd-b9a2-450d-a97d-df3bbe1746e7]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zeSQNVTs'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca7e562-ca52-4150-a022-4d877f3a3ef1]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[67459afb-73df-4484-b5c8-957b738c3b9a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:56:50 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 15:56:50 user nova-compute[74658]:  {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:56:50 user nova-compute[74658]: WARNING os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 15:56:50 user nova-compute[74658]: 
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9005eb-a5aa-4624-9e89-7eca295906fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d, portal: 172.16.0.220,3260]
Nov 16 15:56:50 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d, portal: 172.16.0.220,3260] successful.
Nov 16 15:56:50 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1365bc-4803-4299-b6a5-cab21ceca9b8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2820ea6e-0828-485b-8905-2df7ca9c4e10]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d (non-flash)
Nov 16 15:56:50 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d (non-flash)
Nov 16 15:56:50 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[14562141-10a2-4403-b9e3-6bdf08cd9320]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:56:50 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeSQNVTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26238616132663335', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238616132663335', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG nova.objects.instance [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'flavor' on Instance uuid 470b727f-9673-4d82-8b56-6b52bfe302c5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 15:56:51 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:56:51 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:56:51 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:56:51 user nova-compute[74658]:   <serial>b416c7c8-120f-4d6f-acac-19184de8572d</serial>
Nov 16 15:56:51 user nova-compute[74658]: </disk>
Nov 16 15:56:51 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No VIF found with MAC fa:16:3e:d7:72:5a, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:56:51 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-a0e39f46-0d40-4c35-9f61-15e3f653167b tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.714s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:56:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "a92f6e32-eddc-472b-8710-162198ee9c92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:56:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "a92f6e32-eddc-472b-8710-162198ee9c92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:56:54 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 15:56:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:56:54 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:56:54 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 15:56:54 user nova-compute[74658]: INFO nova.compute.claims [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Claim successful on node user
Nov 16 15:56:55 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG nova.network.neutron [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 15:56:55 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 15:56:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG nova.policy [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b3fb6a56c5847ff8ae46e06544158c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f416cd7c5b4496d8bbf1ee6dad85058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 15:56:55 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Creating image(s)
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "/opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "/opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "/opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.170s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.166s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk 1073741824" returned: 0 in 0.047s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG nova.network.neutron [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Successfully created port: 2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 15:56:55 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Cannot resize image /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Ensure instance console log exists: /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG nova.network.neutron [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Successfully updated port: 2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquired lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG nova.network.neutron [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG nova.network.neutron [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-43dc7dc6-1155-44f8-a75f-efd1fe8f5a5a req-76d0b54f-b8b3-4166-94da-a51cfaf3135c service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Received event network-changed-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG nova.compute.manager [req-43dc7dc6-1155-44f8-a75f-efd1fe8f5a5a req-76d0b54f-b8b3-4166-94da-a51cfaf3135c service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Refreshing instance network info cache due to event network-changed-2d6a8d2c-1174-4f47-ad91-b697e2b39c31. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-43dc7dc6-1155-44f8-a75f-efd1fe8f5a5a req-76d0b54f-b8b3-4166-94da-a51cfaf3135c service nova] Acquiring lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:56:56 user nova-compute[74658]: DEBUG nova.network.neutron [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Updating instance_info_cache with network_info: [{"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Releasing lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Instance network_info: |[{"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-43dc7dc6-1155-44f8-a75f-efd1fe8f5a5a req-76d0b54f-b8b3-4166-94da-a51cfaf3135c service nova] Acquired lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.network.neutron [req-43dc7dc6-1155-44f8-a75f-efd1fe8f5a5a req-76d0b54f-b8b3-4166-94da-a51cfaf3135c service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Refreshing network info cache for port 2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Start _get_guest_xml network_info=[{"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 15:56:57 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:56:57 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1988631129',display_name='tempest-AttachVolumeNegativeTest-server-1988631129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1988631129',id=49,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAs34ZaolxCx1ahvDLT93LBr7UVu/DXGjss3/JlJWhO3EBJU0Kx77cy5Fqwlvk2+O6YvRD6vtAXT2fxbnPLwhQKN0GJ2Z5JeHdvoOfsgx4yXKAEsWbu4WIbDdz5K0pjtA==',key_name='tempest-keypair-421330008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-8s723hs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:56:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=a92f6e32-eddc-472b-8710-162198ee9c92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:4c:3b,bridge_name='br-int',has_traffic_filtering=True,id=2d6a8d2c-1174-4f47-ad91-b697e2b39c31,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6a8d2c-11') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.objects.instance [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'pci_devices' on Instance uuid a92f6e32-eddc-472b-8710-162198ee9c92 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] End _get_guest_xml xml=<domain type="kvm">
Nov 16 15:56:57 user nova-compute[74658]:   <uuid>a92f6e32-eddc-472b-8710-162198ee9c92</uuid>
Nov 16 15:56:57 user nova-compute[74658]:   <name>instance-00000031</name>
Nov 16 15:56:57 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 15:56:57 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 15:56:57 user nova-compute[74658]:   <metadata>
Nov 16 15:56:57 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 15:56:57 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 15:56:57 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1988631129</nova:name>
Nov 16 15:56:57 user nova-compute[74658]:       <nova:creationTime>2023-11-16 15:56:57</nova:creationTime>
Nov 16 15:56:57 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 15:56:57 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 15:56:57 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 15:56:57 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 15:56:57 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 15:56:57 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 15:56:57 user nova-compute[74658]:       </nova:flavor>
Nov 16 15:56:57 user nova-compute[74658]:       <nova:owner>
Nov 16 15:56:57 user nova-compute[74658]:         <nova:user uuid="2b3fb6a56c5847ff8ae46e06544158c7">tempest-AttachVolumeNegativeTest-1769018240-project-member</nova:user>
Nov 16 15:56:57 user nova-compute[74658]:         <nova:project uuid="6f416cd7c5b4496d8bbf1ee6dad85058">tempest-AttachVolumeNegativeTest-1769018240</nova:project>
Nov 16 15:56:57 user nova-compute[74658]:       </nova:owner>
Nov 16 15:56:57 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 15:56:57 user nova-compute[74658]:       <nova:ports>
Nov 16 15:56:57 user nova-compute[74658]:         <nova:port uuid="2d6a8d2c-1174-4f47-ad91-b697e2b39c31">
Nov 16 15:56:57 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 15:56:57 user nova-compute[74658]:         </nova:port>
Nov 16 15:56:57 user nova-compute[74658]:       </nova:ports>
Nov 16 15:56:57 user nova-compute[74658]:     </nova:instance>
Nov 16 15:56:57 user nova-compute[74658]:   </metadata>
Nov 16 15:56:57 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 15:56:57 user nova-compute[74658]:     <system>
Nov 16 15:56:57 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 15:56:57 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 15:56:57 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 15:56:57 user nova-compute[74658]:       <entry name="serial">a92f6e32-eddc-472b-8710-162198ee9c92</entry>
Nov 16 15:56:57 user nova-compute[74658]:       <entry name="uuid">a92f6e32-eddc-472b-8710-162198ee9c92</entry>
Nov 16 15:56:57 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 15:56:57 user nova-compute[74658]:     </system>
Nov 16 15:56:57 user nova-compute[74658]:   </sysinfo>
Nov 16 15:56:57 user nova-compute[74658]:   <os>
Nov 16 15:56:57 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 15:56:57 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 15:56:57 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 15:56:57 user nova-compute[74658]:   </os>
Nov 16 15:56:57 user nova-compute[74658]:   <features>
Nov 16 15:56:57 user nova-compute[74658]:     <acpi/>
Nov 16 15:56:57 user nova-compute[74658]:     <apic/>
Nov 16 15:56:57 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 15:56:57 user nova-compute[74658]:   </features>
Nov 16 15:56:57 user nova-compute[74658]:   <clock offset="utc">
Nov 16 15:56:57 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 15:56:57 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 15:56:57 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 15:56:57 user nova-compute[74658]:   </clock>
Nov 16 15:56:57 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 15:56:57 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 15:56:57 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 15:56:57 user nova-compute[74658]:   </cpu>
Nov 16 15:56:57 user nova-compute[74658]:   <devices>
Nov 16 15:56:57 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 15:56:57 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 15:56:57 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk"/>
Nov 16 15:56:57 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 15:56:57 user nova-compute[74658]:     </disk>
Nov 16 15:56:57 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 15:56:57 user nova-compute[74658]:       <mac address="fa:16:3e:09:4c:3b"/>
Nov 16 15:56:57 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:56:57 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 15:56:57 user nova-compute[74658]:       <target dev="tap2d6a8d2c-11"/>
Nov 16 15:56:57 user nova-compute[74658]:     </interface>
Nov 16 15:56:57 user nova-compute[74658]:     <serial type="pty">
Nov 16 15:56:57 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/console.log" append="off"/>
Nov 16 15:56:57 user nova-compute[74658]:     </serial>
Nov 16 15:56:57 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 15:56:57 user nova-compute[74658]:     <video>
Nov 16 15:56:57 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 15:56:57 user nova-compute[74658]:     </video>
Nov 16 15:56:57 user nova-compute[74658]:     <rng model="virtio">
Nov 16 15:56:57 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 15:56:57 user nova-compute[74658]:     </rng>
Nov 16 15:56:57 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 15:56:57 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 15:56:57 user nova-compute[74658]:       <stats period="10"/>
Nov 16 15:56:57 user nova-compute[74658]:     </memballoon>
Nov 16 15:56:57 user nova-compute[74658]:   </devices>
Nov 16 15:56:57 user nova-compute[74658]: </domain>
Nov 16 15:56:57 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1988631129',display_name='tempest-AttachVolumeNegativeTest-server-1988631129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1988631129',id=49,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAs34ZaolxCx1ahvDLT93LBr7UVu/DXGjss3/JlJWhO3EBJU0Kx77cy5Fqwlvk2+O6YvRD6vtAXT2fxbnPLwhQKN0GJ2Z5JeHdvoOfsgx4yXKAEsWbu4WIbDdz5K0pjtA==',key_name='tempest-keypair-421330008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-8s723hs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T15:56:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=a92f6e32-eddc-472b-8710-162198ee9c92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:4c:3b,bridge_name='br-int',has_traffic_filtering=True,id=2d6a8d2c-1174-4f47-ad91-b697e2b39c31,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6a8d2c-11') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG os_vif [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:4c:3b,bridge_name='br-int',has_traffic_filtering=True,id=2d6a8d2c-1174-4f47-ad91-b697e2b39c31,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6a8d2c-11') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd219c5a9-b8b0-56ac-bfce-220c62fabc4f', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d6a8d2c-11, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d6a8d2c-11, col_values=(('qos', UUID('fa723727-f3ac-4c26-9598-026337737113')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d6a8d2c-11, col_values=(('external_ids', {'iface-id': '2d6a8d2c-1174-4f47-ad91-b697e2b39c31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:4c:3b', 'vm-uuid': 'a92f6e32-eddc-472b-8710-162198ee9c92'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:57 user nova-compute[74658]: INFO os_vif [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:4c:3b,bridge_name='br-int',has_traffic_filtering=True,id=2d6a8d2c-1174-4f47-ad91-b697e2b39c31,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6a8d2c-11')
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No VIF found with MAC fa:16:3e:09:4c:3b, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.network.neutron [req-43dc7dc6-1155-44f8-a75f-efd1fe8f5a5a req-76d0b54f-b8b3-4166-94da-a51cfaf3135c service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Updated VIF entry in instance network info cache for port 2d6a8d2c-1174-4f47-ad91-b697e2b39c31. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG nova.network.neutron [req-43dc7dc6-1155-44f8-a75f-efd1fe8f5a5a req-76d0b54f-b8b3-4166-94da-a51cfaf3135c service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Updating instance_info_cache with network_info: [{"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:56:57 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-43dc7dc6-1155-44f8-a75f-efd1fe8f5a5a req-76d0b54f-b8b3-4166-94da-a51cfaf3135c service nova] Releasing lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Received event network-vif-plugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] Acquiring lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] Lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] Lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] No waiting events found dispatching network-vif-plugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:56:58 user nova-compute[74658]: WARNING nova.compute.manager [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Received unexpected event network-vif-plugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 for instance with vm_state building and task_state spawning.
Nov 16 15:56:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Received event network-vif-plugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] Acquiring lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] Lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] Lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:56:58 user nova-compute[74658]: DEBUG nova.compute.manager [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] No waiting events found dispatching network-vif-plugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:56:58 user nova-compute[74658]: WARNING nova.compute.manager [req-a930bd33-29e3-49e0-957b-b717458d2027 req-0b3f7bdf-d247-4213-a4b5-ba92530da9fc service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Received unexpected event network-vif-plugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 for instance with vm_state building and task_state spawning.
Nov 16 15:57:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 15:57:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 15:57:00 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Instance spawned successfully.
Nov 16 15:57:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 15:57:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:57:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:57:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:57:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:57:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:57:00 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 15:57:00 user nova-compute[74658]: INFO nova.compute.manager [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 16 15:57:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 15:57:00 user nova-compute[74658]: INFO nova.compute.manager [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Took 5.89 seconds to build instance.
Nov 16 15:57:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-e3521128-2904-4fe1-8f79-c322f37dd909 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "a92f6e32-eddc-472b-8710-162198ee9c92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.983s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:57:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:57:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:57:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:57:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:57:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:57:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:57:29 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:57:30 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:57:30 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:57:30 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8917MB free_disk=25.21096420288086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 470b727f-9673-4d82-8b56-6b52bfe302c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance a92f6e32-eddc-472b-8710-162198ee9c92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:57:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:57:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:32 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:57:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:57:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:57:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:57:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:57:32 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:57:32 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 470b727f-9673-4d82-8b56-6b52bfe302c5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:57:33 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updating instance_info_cache with network_info: [{"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:57:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:57:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:57:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:57:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:57:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:57:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:37 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:57:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:57:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:57:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:57:53 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:57:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:57:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:57:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:57:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:57:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:57:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:58:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:58:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:28 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:58:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:58:31 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:58:31 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=25.210243225097656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 470b727f-9673-4d82-8b56-6b52bfe302c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance a92f6e32-eddc-472b-8710-162198ee9c92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:58:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:58:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:58:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:58:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:58:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:58:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:32 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:58:32 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:58:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:58:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:58:33 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:58:33 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Updating instance_info_cache with network_info: [{"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:58:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:58:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:58:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:58:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:58:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:58:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:58:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:58:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 15:58:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:38 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:58:38 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:58:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-60d7b7ee-6d1f-4b33-a10d-3552816fb57d req-e780ae78-102e-441e-8b40-d98e9c47732c service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Received event network-changed-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-60d7b7ee-6d1f-4b33-a10d-3552816fb57d req-e780ae78-102e-441e-8b40-d98e9c47732c service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Refreshing instance network info cache due to event network-changed-2d6a8d2c-1174-4f47-ad91-b697e2b39c31. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-60d7b7ee-6d1f-4b33-a10d-3552816fb57d req-e780ae78-102e-441e-8b40-d98e9c47732c service nova] Acquiring lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-60d7b7ee-6d1f-4b33-a10d-3552816fb57d req-e780ae78-102e-441e-8b40-d98e9c47732c service nova] Acquired lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG nova.network.neutron [req-60d7b7ee-6d1f-4b33-a10d-3552816fb57d req-e780ae78-102e-441e-8b40-d98e9c47732c service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Refreshing network info cache for port 2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "a92f6e32-eddc-472b-8710-162198ee9c92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "a92f6e32-eddc-472b-8710-162198ee9c92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:58:46 user nova-compute[74658]: INFO nova.compute.manager [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Terminating instance
Nov 16 15:58:46 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG nova.network.neutron [req-60d7b7ee-6d1f-4b33-a10d-3552816fb57d req-e780ae78-102e-441e-8b40-d98e9c47732c service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Updated VIF entry in instance network info cache for port 2d6a8d2c-1174-4f47-ad91-b697e2b39c31. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG nova.network.neutron [req-60d7b7ee-6d1f-4b33-a10d-3552816fb57d req-e780ae78-102e-441e-8b40-d98e9c47732c service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Updating instance_info_cache with network_info: [{"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-60d7b7ee-6d1f-4b33-a10d-3552816fb57d req-e780ae78-102e-441e-8b40-d98e9c47732c service nova] Releasing lock "refresh_cache-a92f6e32-eddc-472b-8710-162198ee9c92" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-d84e4701-3b80-4536-adde-b791f9aec7e9 req-336e9d80-8220-49d4-8d38-d070329a7aa3 service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Received event network-vif-unplugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d84e4701-3b80-4536-adde-b791f9aec7e9 req-336e9d80-8220-49d4-8d38-d070329a7aa3 service nova] Acquiring lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d84e4701-3b80-4536-adde-b791f9aec7e9 req-336e9d80-8220-49d4-8d38-d070329a7aa3 service nova] Lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-d84e4701-3b80-4536-adde-b791f9aec7e9 req-336e9d80-8220-49d4-8d38-d070329a7aa3 service nova] Lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-d84e4701-3b80-4536-adde-b791f9aec7e9 req-336e9d80-8220-49d4-8d38-d070329a7aa3 service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] No waiting events found dispatching network-vif-unplugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG nova.compute.manager [req-d84e4701-3b80-4536-adde-b791f9aec7e9 req-336e9d80-8220-49d4-8d38-d070329a7aa3 service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Received event network-vif-unplugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Instance destroyed successfully.
Nov 16 15:58:47 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'resources' on Instance uuid a92f6e32-eddc-472b-8710-162198ee9c92 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1988631129',display_name='tempest-AttachVolumeNegativeTest-server-1988631129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1988631129',id=49,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAs34ZaolxCx1ahvDLT93LBr7UVu/DXGjss3/JlJWhO3EBJU0Kx77cy5Fqwlvk2+O6YvRD6vtAXT2fxbnPLwhQKN0GJ2Z5JeHdvoOfsgx4yXKAEsWbu4WIbDdz5K0pjtA==',key_name='tempest-keypair-421330008',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:57:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-8s723hs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:57:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=a92f6e32-eddc-472b-8710-162198ee9c92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "address": "fa:16:3e:09:4c:3b", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6a8d2c-11", "ovs_interfaceid": "2d6a8d2c-1174-4f47-ad91-b697e2b39c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:4c:3b,bridge_name='br-int',has_traffic_filtering=True,id=2d6a8d2c-1174-4f47-ad91-b697e2b39c31,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6a8d2c-11') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG os_vif [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:4c:3b,bridge_name='br-int',has_traffic_filtering=True,id=2d6a8d2c-1174-4f47-ad91-b697e2b39c31,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6a8d2c-11') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d6a8d2c-11, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa723727-f3ac-4c26-9598-026337737113) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:58:47 user nova-compute[74658]: INFO os_vif [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:4c:3b,bridge_name='br-int',has_traffic_filtering=True,id=2d6a8d2c-1174-4f47-ad91-b697e2b39c31,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6a8d2c-11')
Nov 16 15:58:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Deleting instance files /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92_del
Nov 16 15:58:47 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Deletion of /opt/stack/data/nova/instances/a92f6e32-eddc-472b-8710-162198ee9c92_del complete
Nov 16 15:58:47 user nova-compute[74658]: INFO nova.compute.manager [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Took 0.64 seconds to destroy the instance on the hypervisor.
Nov 16 15:58:47 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 15:58:47 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 15:58:48 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:58:48 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Took 1.11 seconds to deallocate network for instance.
Nov 16 15:58:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:58:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:58:48 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:58:48 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:58:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:58:48 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Deleted allocations for instance a92f6e32-eddc-472b-8710-162198ee9c92
Nov 16 15:58:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5bf7b835-093b-45c3-b162-2be34164dae2 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "a92f6e32-eddc-472b-8710-162198ee9c92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.106s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:58:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-78364247-2424-42af-95eb-9f8cf3bec9cc req-9a6b7d4a-2e17-4e36-9254-c95c07a26339 service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Received event network-vif-plugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:58:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78364247-2424-42af-95eb-9f8cf3bec9cc req-9a6b7d4a-2e17-4e36-9254-c95c07a26339 service nova] Acquiring lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:58:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78364247-2424-42af-95eb-9f8cf3bec9cc req-9a6b7d4a-2e17-4e36-9254-c95c07a26339 service nova] Lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:58:48 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-78364247-2424-42af-95eb-9f8cf3bec9cc req-9a6b7d4a-2e17-4e36-9254-c95c07a26339 service nova] Lock "a92f6e32-eddc-472b-8710-162198ee9c92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:58:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-78364247-2424-42af-95eb-9f8cf3bec9cc req-9a6b7d4a-2e17-4e36-9254-c95c07a26339 service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] No waiting events found dispatching network-vif-plugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 15:58:48 user nova-compute[74658]: WARNING nova.compute.manager [req-78364247-2424-42af-95eb-9f8cf3bec9cc req-9a6b7d4a-2e17-4e36-9254-c95c07a26339 service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Received unexpected event network-vif-plugged-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 for instance with vm_state deleted and task_state None.
Nov 16 15:58:48 user nova-compute[74658]: DEBUG nova.compute.manager [req-78364247-2424-42af-95eb-9f8cf3bec9cc req-9a6b7d4a-2e17-4e36-9254-c95c07a26339 service nova] [instance: a92f6e32-eddc-472b-8710-162198ee9c92] Received event network-vif-deleted-2d6a8d2c-1174-4f47-ad91-b697e2b39c31 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 15:58:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:58:58 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:58:58 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 15:58:58 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 15:59:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:59:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:59:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:59:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 15:59:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:59:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 15:59:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:59:08 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:59:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:59:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:59:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:59:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:59:28 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 15:59:32 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:59:32 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:59:32 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 15:59:32 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9080MB free_disk=25.237361907958984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 15:59:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:59:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:59:32 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 470b727f-9673-4d82-8b56-6b52bfe302c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 15:59:32 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 15:59:32 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 15:59:32 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 15:59:32 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 15:59:32 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 15:59:32 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 470b727f-9673-4d82-8b56-6b52bfe302c5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updating instance_info_cache with network_info: [{"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-470b727f-9673-4d82-8b56-6b52bfe302c5" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:59:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 15:59:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:59:37 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:59:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "470b727f-9673-4d82-8b56-6b52bfe302c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 15:59:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 15:59:37 user nova-compute[74658]: INFO nova.compute.manager [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Detaching volume b416c7c8-120f-4d6f-acac-19184de8572d
Nov 16 15:59:37 user nova-compute[74658]: INFO nova.virt.block_device [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Attempting to driver detach volume b416c7c8-120f-4d6f-acac-19184de8572d from mountpoint /dev/vdb
Nov 16 15:59:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Attempting to detach device vdb from instance 470b727f-9673-4d82-8b56-6b52bfe302c5 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 15:59:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:59:37 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:59:37 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:59:37 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:59:37 user nova-compute[74658]:   <serial>b416c7c8-120f-4d6f-acac-19184de8572d</serial>
Nov 16 15:59:37 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:59:37 user nova-compute[74658]: </disk>
Nov 16 15:59:37 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:59:37 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully detached device vdb from instance 470b727f-9673-4d82-8b56-6b52bfe302c5 from the persistent domain config.
Nov 16 15:59:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 470b727f-9673-4d82-8b56-6b52bfe302c5 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 15:59:37 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 15:59:37 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 15:59:37 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 15:59:37 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 15:59:37 user nova-compute[74658]:   <serial>b416c7c8-120f-4d6f-acac-19184de8572d</serial>
Nov 16 15:59:37 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 15:59:37 user nova-compute[74658]: </disk>
Nov 16 15:59:37 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 15:59:38 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 470b727f-9673-4d82-8b56-6b52bfe302c5 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 15:59:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:59:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:59:42 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:59:47 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:59:52 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 15:59:55 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 15:59:57 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 15:59:58 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 470b727f-9673-4d82-8b56-6b52bfe302c5 is timed out.
Nov 16 15:59:58 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully detached device vdb from instance 470b727f-9673-4d82-8b56-6b52bfe302c5 from the live domain config.
Nov 16 15:59:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeSQNVTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 15:59:58 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ec3dfd-e9c3-44d8-bb85-dd67427b470d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 15:59:58 user nova-compute[74658]: No targets found.
Nov 16 15:59:58 user nova-compute[74658]: iSNS:
Nov 16 15:59:58 user nova-compute[74658]: No targets found.
Nov 16 15:59:58 user nova-compute[74658]: STATIC:
Nov 16 15:59:58 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d
Nov 16 15:59:58 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 15:59:58 user nova-compute[74658]:                 Iface Name: default
Nov 16 15:59:58 user nova-compute[74658]: FIRMWARE:
Nov 16 15:59:58 user nova-compute[74658]: No targets found.
Nov 16 15:59:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 15:59:58 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 15:59:58 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91bdf0f-0e14-4af8-b062-17b153a98629]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ec6a03-29e3-487e-814b-c82bb7730cbf]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d (non-flash)
Nov 16 15:59:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d (non-flash)
Nov 16 15:59:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07101271c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8b28e7-dec5-4451-bb17-4926276da757]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c250457-b299-4b98-9993-017e2b08b1f1]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[69917a41-72c5-4941-9073-1d4beff7683d]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0424dd-4db7-48b6-84ed-f266825292d0]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcea84d2-41c5-45d5-add5-e9845094fce7]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca10361-794d-4d3f-88fc-529b6d0195a1]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d, portal: 172.16.0.220,3260]
Nov 16 15:59:58 user nova-compute[74658]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d, portal: 172.16.0.220,3260] successful.
Nov 16 15:59:58 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b416c7c8-120f-4d6f-acac-19184de8572d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cfcb39-2cbc-434c-aa40-3df2cb0cde51]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] <== disconnect_volume: return (326ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 15:59:58 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 15:59:59 user nova-compute[74658]: DEBUG nova.objects.instance [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'flavor' on Instance uuid 470b727f-9673-4d82-8b56-6b52bfe302c5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 15:59:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6f9cbe47-6f42-4b03-9578-eab495cdc812 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.791s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:00:02 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:07 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:17 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:22 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:27 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "470b727f-9673-4d82-8b56-6b52bfe302c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:00:28 user nova-compute[74658]: INFO nova.compute.manager [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Terminating instance
Nov 16 16:00:28 user nova-compute[74658]: DEBUG nova.compute.manager [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-92dc6fa0-d4ec-41a4-9554-19f8a2c9138e req-cbb4a2d3-f238-4ad5-b1be-18e81a2a0088 service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Received event network-vif-unplugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-92dc6fa0-d4ec-41a4-9554-19f8a2c9138e req-cbb4a2d3-f238-4ad5-b1be-18e81a2a0088 service nova] Acquiring lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-92dc6fa0-d4ec-41a4-9554-19f8a2c9138e req-cbb4a2d3-f238-4ad5-b1be-18e81a2a0088 service nova] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-92dc6fa0-d4ec-41a4-9554-19f8a2c9138e req-cbb4a2d3-f238-4ad5-b1be-18e81a2a0088 service nova] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-92dc6fa0-d4ec-41a4-9554-19f8a2c9138e req-cbb4a2d3-f238-4ad5-b1be-18e81a2a0088 service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] No waiting events found dispatching network-vif-unplugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG nova.compute.manager [req-92dc6fa0-d4ec-41a4-9554-19f8a2c9138e req-cbb4a2d3-f238-4ad5-b1be-18e81a2a0088 service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Received event network-vif-unplugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:28 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Instance destroyed successfully.
Nov 16 16:00:28 user nova-compute[74658]: DEBUG nova.objects.instance [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'resources' on Instance uuid 470b727f-9673-4d82-8b56-6b52bfe302c5 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T15:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-4931998',display_name='tempest-AttachVolumeNegativeTest-server-4931998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-4931998',id=48,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDOSLvPd21UmD+7ihlVv9B8pohhlqiqulQ3EMBAu604w0NDKfhKrf7cHN863oIlCJ2EQdzVIHnCTvgePGA7UCSKOkNhw6wBDfbnP/U/defZ7jA+cpij+L1EPEM5Uj8CHQ==',key_name='tempest-keypair-324519684',keypairs=<?>,launch_index=0,launched_at=2023-11-16T15:54:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-h9ktpbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T15:54:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=470b727f-9673-4d82-8b56-6b52bfe302c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "address": "fa:16:3e:d7:72:5a", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210dc1ec-a0", "ovs_interfaceid": "210dc1ec-a0ef-44c5-b7ba-07f736dd5406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:72:5a,bridge_name='br-int',has_traffic_filtering=True,id=210dc1ec-a0ef-44c5-b7ba-07f736dd5406,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210dc1ec-a0') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG os_vif [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:72:5a,bridge_name='br-int',has_traffic_filtering=True,id=210dc1ec-a0ef-44c5-b7ba-07f736dd5406,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210dc1ec-a0') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap210dc1ec-a0, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=daa6d316-d5a4-4523-a4f3-8745e1ce7b00) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:00:28 user nova-compute[74658]: INFO os_vif [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:72:5a,bridge_name='br-int',has_traffic_filtering=True,id=210dc1ec-a0ef-44c5-b7ba-07f736dd5406,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210dc1ec-a0')
Nov 16 16:00:28 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Deleting instance files /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5_del
Nov 16 16:00:28 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Deletion of /opt/stack/data/nova/instances/470b727f-9673-4d82-8b56-6b52bfe302c5_del complete
Nov 16 16:00:28 user nova-compute[74658]: INFO nova.compute.manager [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 16 16:00:28 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 16:00:28 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 16:00:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:00:29 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:00:29 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Took 0.75 seconds to deallocate network for instance.
Nov 16 16:00:29 user nova-compute[74658]: DEBUG nova.compute.manager [req-652d55c2-6670-46b6-9ebb-944f61dfa12b req-0e1733ad-6f6f-49b9-a3ae-80d05052dfb0 service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Received event network-vif-deleted-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:00:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:00:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:00:29 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:00:29 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:00:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:00:29 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Deleted allocations for instance 470b727f-9673-4d82-8b56-6b52bfe302c5
Nov 16 16:00:29 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-af2f4828-afc4-41b9-8022-94b6f73c4bf7 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.900s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:00:30 user nova-compute[74658]: DEBUG nova.compute.manager [req-5696572a-a365-4b7e-8cd6-ebdd8231e0bf req-95229cc2-792a-4446-945d-bc19dd739594 service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Received event network-vif-plugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:00:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5696572a-a365-4b7e-8cd6-ebdd8231e0bf req-95229cc2-792a-4446-945d-bc19dd739594 service nova] Acquiring lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:00:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5696572a-a365-4b7e-8cd6-ebdd8231e0bf req-95229cc2-792a-4446-945d-bc19dd739594 service nova] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:00:30 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5696572a-a365-4b7e-8cd6-ebdd8231e0bf req-95229cc2-792a-4446-945d-bc19dd739594 service nova] Lock "470b727f-9673-4d82-8b56-6b52bfe302c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:00:30 user nova-compute[74658]: DEBUG nova.compute.manager [req-5696572a-a365-4b7e-8cd6-ebdd8231e0bf req-95229cc2-792a-4446-945d-bc19dd739594 service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] No waiting events found dispatching network-vif-plugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:00:30 user nova-compute[74658]: WARNING nova.compute.manager [req-5696572a-a365-4b7e-8cd6-ebdd8231e0bf req-95229cc2-792a-4446-945d-bc19dd739594 service nova] [instance: 470b727f-9673-4d82-8b56-6b52bfe302c5] Received unexpected event network-vif-plugged-210dc1ec-a0ef-44c5-b7ba-07f736dd5406 for instance with vm_state deleted and task_state None.
Nov 16 16:00:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:00:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:00:33 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:00:33 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:00:33 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9209MB free_disk=25.264469146728516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:00:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:34 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:00:34 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:00:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:00:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:00:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:00:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:00:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:00:41 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:00:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:00:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:00:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:00:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:00:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:00:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:00:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:00:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:00:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:01:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:01:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:01:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:01:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:01:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:01:13 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:01:18 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "8d5e667c-3598-4d54-a883-0253873bda01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:01:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:01:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 16:01:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:01:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:01:21 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 16:01:21 user nova-compute[74658]: INFO nova.compute.claims [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Claim successful on node user
Nov 16 16:01:22 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 16:01:22 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 16:01:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG nova.policy [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b3fb6a56c5847ff8ae46e06544158c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f416cd7c5b4496d8bbf1ee6dad85058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG nova.compute.manager [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 16:01:22 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Creating image(s)
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "/opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "/opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk 1073741824" returned: 0 in 0.048s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:01:22 user nova-compute[74658]: DEBUG nova.network.neutron [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Successfully created port: 4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.192s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Cannot resize image /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Ensure instance console log exists: /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Successfully updated port: 4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquired lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-4cf3f08f-dd97-4e90-b418-0c9bffaba582 req-b44697d1-748e-4533-99cc-758427ed0fc3 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Received event network-changed-4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.compute.manager [req-4cf3f08f-dd97-4e90-b418-0c9bffaba582 req-b44697d1-748e-4533-99cc-758427ed0fc3 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Refreshing instance network info cache due to event network-changed-4288cc40-1e9f-4b4e-8714-d9485009761f. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4cf3f08f-dd97-4e90-b418-0c9bffaba582 req-b44697d1-748e-4533-99cc-758427ed0fc3 service nova] Acquiring lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.network.neutron [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updating instance_info_cache with network_info: [{"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Releasing lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.compute.manager [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Instance network_info: |[{"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4cf3f08f-dd97-4e90-b418-0c9bffaba582 req-b44697d1-748e-4533-99cc-758427ed0fc3 service nova] Acquired lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.network.neutron [req-4cf3f08f-dd97-4e90-b418-0c9bffaba582 req-b44697d1-748e-4533-99cc-758427ed0fc3 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Refreshing network info cache for port 4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Start _get_guest_xml network_info=[{"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 16:01:23 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:01:23 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T16:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1733790050',display_name='tempest-AttachVolumeNegativeTest-server-1733790050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1733790050',id=50,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKoVOxOtBFR1dmFPFDbn4/aA5iZaEs56rTLFQ01CPyTqb7+/0PoasoD0rH88aq+hQOCuEme2ckPoh9IRL9pv/ZuWE8z0YSWsiM26ayP2PzTXXkUOxadVESDa9lJUCJ/KA==',key_name='tempest-keypair-216914981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-nkwhcl1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T16:01:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=8d5e667c-3598-4d54-a883-0253873bda01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b8:46,bridge_name='br-int',has_traffic_filtering=True,id=4288cc40-1e9f-4b4e-8714-d9485009761f,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4288cc40-1e') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.objects.instance [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d5e667c-3598-4d54-a883-0253873bda01 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] End _get_guest_xml xml=<domain type="kvm">
Nov 16 16:01:23 user nova-compute[74658]:   <uuid>8d5e667c-3598-4d54-a883-0253873bda01</uuid>
Nov 16 16:01:23 user nova-compute[74658]:   <name>instance-00000032</name>
Nov 16 16:01:23 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 16:01:23 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 16:01:23 user nova-compute[74658]:   <metadata>
Nov 16 16:01:23 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 16:01:23 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 16:01:23 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1733790050</nova:name>
Nov 16 16:01:23 user nova-compute[74658]:       <nova:creationTime>2023-11-16 16:01:23</nova:creationTime>
Nov 16 16:01:23 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 16:01:23 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 16:01:23 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 16:01:23 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 16:01:23 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 16:01:23 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 16:01:23 user nova-compute[74658]:       </nova:flavor>
Nov 16 16:01:23 user nova-compute[74658]:       <nova:owner>
Nov 16 16:01:23 user nova-compute[74658]:         <nova:user uuid="2b3fb6a56c5847ff8ae46e06544158c7">tempest-AttachVolumeNegativeTest-1769018240-project-member</nova:user>
Nov 16 16:01:23 user nova-compute[74658]:         <nova:project uuid="6f416cd7c5b4496d8bbf1ee6dad85058">tempest-AttachVolumeNegativeTest-1769018240</nova:project>
Nov 16 16:01:23 user nova-compute[74658]:       </nova:owner>
Nov 16 16:01:23 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 16:01:23 user nova-compute[74658]:       <nova:ports>
Nov 16 16:01:23 user nova-compute[74658]:         <nova:port uuid="4288cc40-1e9f-4b4e-8714-d9485009761f">
Nov 16 16:01:23 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 16:01:23 user nova-compute[74658]:         </nova:port>
Nov 16 16:01:23 user nova-compute[74658]:       </nova:ports>
Nov 16 16:01:23 user nova-compute[74658]:     </nova:instance>
Nov 16 16:01:23 user nova-compute[74658]:   </metadata>
Nov 16 16:01:23 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 16:01:23 user nova-compute[74658]:     <system>
Nov 16 16:01:23 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 16:01:23 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 16:01:23 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 16:01:23 user nova-compute[74658]:       <entry name="serial">8d5e667c-3598-4d54-a883-0253873bda01</entry>
Nov 16 16:01:23 user nova-compute[74658]:       <entry name="uuid">8d5e667c-3598-4d54-a883-0253873bda01</entry>
Nov 16 16:01:23 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 16:01:23 user nova-compute[74658]:     </system>
Nov 16 16:01:23 user nova-compute[74658]:   </sysinfo>
Nov 16 16:01:23 user nova-compute[74658]:   <os>
Nov 16 16:01:23 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 16:01:23 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 16:01:23 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 16:01:23 user nova-compute[74658]:   </os>
Nov 16 16:01:23 user nova-compute[74658]:   <features>
Nov 16 16:01:23 user nova-compute[74658]:     <acpi/>
Nov 16 16:01:23 user nova-compute[74658]:     <apic/>
Nov 16 16:01:23 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 16:01:23 user nova-compute[74658]:   </features>
Nov 16 16:01:23 user nova-compute[74658]:   <clock offset="utc">
Nov 16 16:01:23 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 16:01:23 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 16:01:23 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 16:01:23 user nova-compute[74658]:   </clock>
Nov 16 16:01:23 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 16:01:23 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 16:01:23 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 16:01:23 user nova-compute[74658]:   </cpu>
Nov 16 16:01:23 user nova-compute[74658]:   <devices>
Nov 16 16:01:23 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 16:01:23 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 16:01:23 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk"/>
Nov 16 16:01:23 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 16:01:23 user nova-compute[74658]:     </disk>
Nov 16 16:01:23 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 16:01:23 user nova-compute[74658]:       <mac address="fa:16:3e:bc:b8:46"/>
Nov 16 16:01:23 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 16:01:23 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 16:01:23 user nova-compute[74658]:       <target dev="tap4288cc40-1e"/>
Nov 16 16:01:23 user nova-compute[74658]:     </interface>
Nov 16 16:01:23 user nova-compute[74658]:     <serial type="pty">
Nov 16 16:01:23 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/console.log" append="off"/>
Nov 16 16:01:23 user nova-compute[74658]:     </serial>
Nov 16 16:01:23 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 16:01:23 user nova-compute[74658]:     <video>
Nov 16 16:01:23 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 16:01:23 user nova-compute[74658]:     </video>
Nov 16 16:01:23 user nova-compute[74658]:     <rng model="virtio">
Nov 16 16:01:23 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 16:01:23 user nova-compute[74658]:     </rng>
Nov 16 16:01:23 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 16:01:23 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 16:01:23 user nova-compute[74658]:       <stats period="10"/>
Nov 16 16:01:23 user nova-compute[74658]:     </memballoon>
Nov 16 16:01:23 user nova-compute[74658]:   </devices>
Nov 16 16:01:23 user nova-compute[74658]: </domain>
Nov 16 16:01:23 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T16:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1733790050',display_name='tempest-AttachVolumeNegativeTest-server-1733790050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1733790050',id=50,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKoVOxOtBFR1dmFPFDbn4/aA5iZaEs56rTLFQ01CPyTqb7+/0PoasoD0rH88aq+hQOCuEme2ckPoh9IRL9pv/ZuWE8z0YSWsiM26ayP2PzTXXkUOxadVESDa9lJUCJ/KA==',key_name='tempest-keypair-216914981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-nkwhcl1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T16:01:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=8d5e667c-3598-4d54-a883-0253873bda01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b8:46,bridge_name='br-int',has_traffic_filtering=True,id=4288cc40-1e9f-4b4e-8714-d9485009761f,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4288cc40-1e') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG os_vif [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b8:46,bridge_name='br-int',has_traffic_filtering=True,id=4288cc40-1e9f-4b4e-8714-d9485009761f,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4288cc40-1e') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8311b2eb-3cb6-594b-84ab-3991eb68324c', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4288cc40-1e, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4288cc40-1e, col_values=(('qos', UUID('815334a4-e558-4b11-a6df-3c0eb07d50a1')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4288cc40-1e, col_values=(('external_ids', {'iface-id': '4288cc40-1e9f-4b4e-8714-d9485009761f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:b8:46', 'vm-uuid': '8d5e667c-3598-4d54-a883-0253873bda01'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:01:23 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:23 user nova-compute[74658]: INFO os_vif [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b8:46,bridge_name='br-int',has_traffic_filtering=True,id=4288cc40-1e9f-4b4e-8714-d9485009761f,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4288cc40-1e')
Nov 16 16:01:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:01:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No VIF found with MAC fa:16:3e:bc:b8:46, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 16:01:24 user nova-compute[74658]: DEBUG nova.network.neutron [req-4cf3f08f-dd97-4e90-b418-0c9bffaba582 req-b44697d1-748e-4533-99cc-758427ed0fc3 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updated VIF entry in instance network info cache for port 4288cc40-1e9f-4b4e-8714-d9485009761f. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 16:01:24 user nova-compute[74658]: DEBUG nova.network.neutron [req-4cf3f08f-dd97-4e90-b418-0c9bffaba582 req-b44697d1-748e-4533-99cc-758427ed0fc3 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updating instance_info_cache with network_info: [{"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:01:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-4cf3f08f-dd97-4e90-b418-0c9bffaba582 req-b44697d1-748e-4533-99cc-758427ed0fc3 service nova] Releasing lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:01:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-e30f45a8-d675-443c-acee-9aabaefe67c2 req-3f721461-5ba8-48b3-86fc-357db2528d58 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Received event network-vif-plugged-4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:01:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e30f45a8-d675-443c-acee-9aabaefe67c2 req-3f721461-5ba8-48b3-86fc-357db2528d58 service nova] Acquiring lock "8d5e667c-3598-4d54-a883-0253873bda01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:01:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e30f45a8-d675-443c-acee-9aabaefe67c2 req-3f721461-5ba8-48b3-86fc-357db2528d58 service nova] Lock "8d5e667c-3598-4d54-a883-0253873bda01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:01:25 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-e30f45a8-d675-443c-acee-9aabaefe67c2 req-3f721461-5ba8-48b3-86fc-357db2528d58 service nova] Lock "8d5e667c-3598-4d54-a883-0253873bda01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:01:25 user nova-compute[74658]: DEBUG nova.compute.manager [req-e30f45a8-d675-443c-acee-9aabaefe67c2 req-3f721461-5ba8-48b3-86fc-357db2528d58 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] No waiting events found dispatching network-vif-plugged-4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:01:25 user nova-compute[74658]: WARNING nova.compute.manager [req-e30f45a8-d675-443c-acee-9aabaefe67c2 req-3f721461-5ba8-48b3-86fc-357db2528d58 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Received unexpected event network-vif-plugged-4288cc40-1e9f-4b4e-8714-d9485009761f for instance with vm_state building and task_state spawning.
Nov 16 16:01:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 16:01:27 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Instance spawned successfully.
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:01:27 user nova-compute[74658]: INFO nova.compute.manager [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.compute.manager [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 16:01:27 user nova-compute[74658]: INFO nova.compute.manager [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Took 5.64 seconds to build instance.
Nov 16 16:01:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-826c129d-0fc1-4f93-b471-04d82b1fd3d9 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.740s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.compute.manager [req-812db40e-764b-4f01-afcf-20b5797fe9f9 req-13fbf14e-e94a-4818-ba24-3b6d80655e39 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Received event network-vif-plugged-4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-812db40e-764b-4f01-afcf-20b5797fe9f9 req-13fbf14e-e94a-4818-ba24-3b6d80655e39 service nova] Acquiring lock "8d5e667c-3598-4d54-a883-0253873bda01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-812db40e-764b-4f01-afcf-20b5797fe9f9 req-13fbf14e-e94a-4818-ba24-3b6d80655e39 service nova] Lock "8d5e667c-3598-4d54-a883-0253873bda01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-812db40e-764b-4f01-afcf-20b5797fe9f9 req-13fbf14e-e94a-4818-ba24-3b6d80655e39 service nova] Lock "8d5e667c-3598-4d54-a883-0253873bda01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:01:27 user nova-compute[74658]: DEBUG nova.compute.manager [req-812db40e-764b-4f01-afcf-20b5797fe9f9 req-13fbf14e-e94a-4818-ba24-3b6d80655e39 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] No waiting events found dispatching network-vif-plugged-4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:01:27 user nova-compute[74658]: WARNING nova.compute.manager [req-812db40e-764b-4f01-afcf-20b5797fe9f9 req-13fbf14e-e94a-4818-ba24-3b6d80655e39 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Received unexpected event network-vif-plugged-4288cc40-1e9f-4b4e-8714-d9485009761f for instance with vm_state active and task_state None.
Nov 16 16:01:28 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:01:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:01:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 8d5e667c-3598-4d54-a883-0253873bda01 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updating instance_info_cache with network_info: [{"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:01:33 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:34 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:01:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:01:35 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:01:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:01:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:01:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:01:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:01:35 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:01:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:01:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:01:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:01:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:01:36 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:01:36 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:01:36 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9058MB free_disk=25.26253890991211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:01:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:01:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:01:36 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 8d5e667c-3598-4d54-a883-0253873bda01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 16:01:36 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:01:36 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:01:36 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:01:36 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:01:36 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:01:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:01:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:01:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:01:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:01:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:01:38 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:40 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:01:43 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:01:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:01:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:01:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:01:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:01:43 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:48 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:53 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:01:58 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:02:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:02:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:02:08 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:02:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:02:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:02:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:02:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:02:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:02:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:02:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:02:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:02:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:02:29 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:02:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 8d5e667c-3598-4d54-a883-0253873bda01 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updating instance_info_cache with network_info: [{"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:02:34 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 16:02:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:02:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:02:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:02:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:02:35 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:02:35 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:02:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:02:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:02:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:02:35 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:02:36 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:02:36 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:02:36 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9082MB free_disk=25.23410415649414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:02:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:02:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:02:36 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 8d5e667c-3598-4d54-a883-0253873bda01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 16:02:36 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:02:36 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:02:36 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:02:36 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:02:36 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:02:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:02:37 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:02:37 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:02:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:02:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:02:40 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:02:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:02:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:02:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:02:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:02:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:02:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:02:45 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:02:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:02:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:02:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:03:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:03:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:03:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:03:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-3dfbaaae-0bc5-412b-8ad0-e9291c019573 req-fa51169f-d7c3-44a9-8ec4-f25d9c56367b service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Received event network-changed-4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:03:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-3dfbaaae-0bc5-412b-8ad0-e9291c019573 req-fa51169f-d7c3-44a9-8ec4-f25d9c56367b service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Refreshing instance network info cache due to event network-changed-4288cc40-1e9f-4b4e-8714-d9485009761f. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 16:03:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3dfbaaae-0bc5-412b-8ad0-e9291c019573 req-fa51169f-d7c3-44a9-8ec4-f25d9c56367b service nova] Acquiring lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:03:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3dfbaaae-0bc5-412b-8ad0-e9291c019573 req-fa51169f-d7c3-44a9-8ec4-f25d9c56367b service nova] Acquired lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:03:12 user nova-compute[74658]: DEBUG nova.network.neutron [req-3dfbaaae-0bc5-412b-8ad0-e9291c019573 req-fa51169f-d7c3-44a9-8ec4-f25d9c56367b service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Refreshing network info cache for port 4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 16:03:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-3dfbaaae-0bc5-412b-8ad0-e9291c019573 req-fa51169f-d7c3-44a9-8ec4-f25d9c56367b service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updated VIF entry in instance network info cache for port 4288cc40-1e9f-4b4e-8714-d9485009761f. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 16:03:13 user nova-compute[74658]: DEBUG nova.network.neutron [req-3dfbaaae-0bc5-412b-8ad0-e9291c019573 req-fa51169f-d7c3-44a9-8ec4-f25d9c56367b service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updating instance_info_cache with network_info: [{"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:03:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3dfbaaae-0bc5-412b-8ad0-e9291c019573 req-fa51169f-d7c3-44a9-8ec4-f25d9c56367b service nova] Releasing lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:03:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "8d5e667c-3598-4d54-a883-0253873bda01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG nova.objects.instance [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e667c-3598-4d54-a883-0253873bda01 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "8d5e667c-3598-4d54-a883-0253873bda01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:03:15 user nova-compute[74658]: INFO nova.compute.manager [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Attaching volume 56f6446b-00aa-4ac8-97c7-3967b18094fe to /dev/vdb
Nov 16 16:03:15 user nova-compute[74658]: DEBUG os_brick.utils [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0637499-170b-48d5-8eb9-e0d26d81ea51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec236299-89aa-4b89-a9ed-8edd96d38421]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ebd11b-d6ca-483b-be0d-44a4cd507925]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbccd5c-f7d6-4458-b896-60eb8f45640e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 16:03:15 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 16:03:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8603f314-f39a-48ac-adde-17939b1ea106]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG os_brick.utils [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:03:15 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updating existing volume attachment record: 057a2edd-cfd4-416b-adfe-71b3c3cdbd2b {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 16:03:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWMVPmkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:03:21 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:03:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:03:21 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:03:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:03:21 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 16:03:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c01bc1d-dcd4-4415-bbbc-3c75d95ae34f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 16:03:21 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b04a40-8c5a-4e55-970b-50c84a51cdf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe] added
Nov 16 16:03:21 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee655d0d-e84b-49c2-96f0-a88642014dad]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:03:21 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f939a834-8527-49c1-8b2c-2953a275dbe8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWMVPmkt {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWMVPmkt" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8834f5f-a0ce-47ba-8fc2-6e8dcd330b07]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LWMVPmkt'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef1fe32-3285-4057-ba55-b2718da61b0e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b7d083-eb7a-4eb2-813d-12870975a5e5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 16:03:22 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 16:03:22 user nova-compute[74658]:  {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:03:22 user nova-compute[74658]: WARNING os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 16:03:22 user nova-compute[74658]: 
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a578c23-8c5e-4ef8-b0ca-028a8199b801]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe, portal: 172.16.0.220,3260]
Nov 16 16:03:22 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe, portal: 172.16.0.220,3260] successful.
Nov 16 16:03:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23ed67d-0222-4cc1-abac-10e067f6ab70]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[68795f48-2e92-433a-b7e4-2371da3b3585]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe (non-flash)
Nov 16 16:03:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe (non-flash)
Nov 16 16:03:22 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ff605d-26f4-4209-985f-f6dd649b481e]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:22 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 16:03:23 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 16:03:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWMVPmkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 16:03:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:03:23 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26561396133386430', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:03:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561396133386430', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 16:03:23 user nova-compute[74658]: DEBUG nova.objects.instance [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e667c-3598-4d54-a883-0253873bda01 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:03:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 16:03:23 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:03:23 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 16:03:23 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 16:03:23 user nova-compute[74658]:   <serial>56f6446b-00aa-4ac8-97c7-3967b18094fe</serial>
Nov 16 16:03:23 user nova-compute[74658]: </disk>
Nov 16 16:03:23 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 16:03:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:03:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:03:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No VIF found with MAC fa:16:3e:bc:b8:46, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 16:03:23 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-d484156b-ff0f-4e59-97e6-5baedf6814d1 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.976s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:03:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "8d5e667c-3598-4d54-a883-0253873bda01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:03:24 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:03:24 user nova-compute[74658]: INFO nova.compute.manager [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Detaching volume 56f6446b-00aa-4ac8-97c7-3967b18094fe
Nov 16 16:03:24 user nova-compute[74658]: INFO nova.virt.block_device [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Attempting to driver detach volume 56f6446b-00aa-4ac8-97c7-3967b18094fe from mountpoint /dev/vdb
Nov 16 16:03:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Attempting to detach device vdb from instance 8d5e667c-3598-4d54-a883-0253873bda01 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 16:03:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 16:03:24 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:03:24 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 16:03:24 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 16:03:24 user nova-compute[74658]:   <serial>56f6446b-00aa-4ac8-97c7-3967b18094fe</serial>
Nov 16 16:03:24 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 16:03:24 user nova-compute[74658]: </disk>
Nov 16 16:03:24 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 16:03:24 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully detached device vdb from instance 8d5e667c-3598-4d54-a883-0253873bda01 from the persistent domain config.
Nov 16 16:03:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d5e667c-3598-4d54-a883-0253873bda01 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 16:03:24 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 16:03:24 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:03:24 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 16:03:24 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 16:03:24 user nova-compute[74658]:   <serial>56f6446b-00aa-4ac8-97c7-3967b18094fe</serial>
Nov 16 16:03:24 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 16:03:24 user nova-compute[74658]: </disk>
Nov 16 16:03:24 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 16:03:25 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d5e667c-3598-4d54-a883-0253873bda01 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 16:03:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:03:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:03:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:03:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:03:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:03:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:03:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:03:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 8d5e667c-3598-4d54-a883-0253873bda01 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updating instance_info_cache with network_info: [{"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-8d5e667c-3598-4d54-a883-0253873bda01" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:03:36 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:03:37 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:03:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:03:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:03:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:03:37 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:03:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:37 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:38 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:03:38 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9073MB free_disk=25.22534942626953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 8d5e667c-3598-4d54-a883-0253873bda01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:03:38 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:03:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:03:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:03:39 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 16:03:41 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:03:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:03:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:03:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:03:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:03:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:45 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d5e667c-3598-4d54-a883-0253873bda01 is timed out.
Nov 16 16:03:45 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully detached device vdb from instance 8d5e667c-3598-4d54-a883-0253873bda01 from the live domain config.
Nov 16 16:03:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWMVPmkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:03:45 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3293416-2347-44cf-8cb1-fa2439594cec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 16:03:45 user nova-compute[74658]: No targets found.
Nov 16 16:03:45 user nova-compute[74658]: iSNS:
Nov 16 16:03:45 user nova-compute[74658]: No targets found.
Nov 16 16:03:45 user nova-compute[74658]: STATIC:
Nov 16 16:03:45 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe
Nov 16 16:03:45 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 16:03:45 user nova-compute[74658]:                 Iface Name: default
Nov 16 16:03:45 user nova-compute[74658]: FIRMWARE:
Nov 16 16:03:45 user nova-compute[74658]: No targets found.
Nov 16 16:03:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 16:03:45 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 16:03:45 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ae6507-cdc4-45f4-9d42-899f29bf8869]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fa0b2e-84cc-4fc8-9fb4-edb33485e758]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe (non-flash)
Nov 16 16:03:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe (non-flash)
Nov 16 16:03:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06f063df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8b9f3c-a8c4-47fd-b8f8-14b78fae954d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8e748-a8b8-4894-b4cc-6b7ffa6b9132]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b369fe5-cd32-4295-bf5c-eb64684c261b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9362a76d-bd50-4ec6-9fd6-874a824f555d]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bcb126-d2c2-441d-8e72-55f5d3d47079]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f714471-07bd-4c03-825d-7a7d47418a68]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe, portal: 172.16.0.220,3260]
Nov 16 16:03:45 user nova-compute[74658]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe, portal: 172.16.0.220,3260] successful.
Nov 16 16:03:45 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f6446b-00aa-4ac8-97c7-3967b18094fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[32da4b75-c695-4115-b5b5-6f5801e6aeaf]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] <== disconnect_volume: return (273ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:03:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 16:03:46 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:03:46 user nova-compute[74658]: DEBUG nova.objects.instance [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e667c-3598-4d54-a883-0253873bda01 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:03:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-6d6f6692-6f64-450f-830c-443c2b02535e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.555s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:03:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:03:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:03:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:03:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:03:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:03:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:03:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:04:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:04:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:04:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:04:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:04 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 16:04:04 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 16:04:06 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_power_states {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:06 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Triggering sync for uuid 8d5e667c-3598-4d54-a883-0253873bda01 {{(pid=74658) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 16:04:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "8d5e667c-3598-4d54-a883-0253873bda01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:04:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "8d5e667c-3598-4d54-a883-0253873bda01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:04:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "8d5e667c-3598-4d54-a883-0253873bda01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.461s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:04:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:04:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:04:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:04:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:04:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "8d5e667c-3598-4d54-a883-0253873bda01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "8d5e667c-3598-4d54-a883-0253873bda01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:04:15 user nova-compute[74658]: INFO nova.compute.manager [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Terminating instance
Nov 16 16:04:15 user nova-compute[74658]: DEBUG nova.compute.manager [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-f20430c3-ce7a-46dd-bcfa-6bf09e573341 req-16cc06d3-9965-42dc-a70c-1e11cfb7a5db service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Received event network-vif-unplugged-4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f20430c3-ce7a-46dd-bcfa-6bf09e573341 req-16cc06d3-9965-42dc-a70c-1e11cfb7a5db service nova] Acquiring lock "8d5e667c-3598-4d54-a883-0253873bda01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f20430c3-ce7a-46dd-bcfa-6bf09e573341 req-16cc06d3-9965-42dc-a70c-1e11cfb7a5db service nova] Lock "8d5e667c-3598-4d54-a883-0253873bda01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-f20430c3-ce7a-46dd-bcfa-6bf09e573341 req-16cc06d3-9965-42dc-a70c-1e11cfb7a5db service nova] Lock "8d5e667c-3598-4d54-a883-0253873bda01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-f20430c3-ce7a-46dd-bcfa-6bf09e573341 req-16cc06d3-9965-42dc-a70c-1e11cfb7a5db service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] No waiting events found dispatching network-vif-unplugged-4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG nova.compute.manager [req-f20430c3-ce7a-46dd-bcfa-6bf09e573341 req-16cc06d3-9965-42dc-a70c-1e11cfb7a5db service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Received event network-vif-unplugged-4288cc40-1e9f-4b4e-8714-d9485009761f for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:15 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Instance destroyed successfully.
Nov 16 16:04:15 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'resources' on Instance uuid 8d5e667c-3598-4d54-a883-0253873bda01 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T16:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1733790050',display_name='tempest-AttachVolumeNegativeTest-server-1733790050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1733790050',id=50,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKoVOxOtBFR1dmFPFDbn4/aA5iZaEs56rTLFQ01CPyTqb7+/0PoasoD0rH88aq+hQOCuEme2ckPoh9IRL9pv/ZuWE8z0YSWsiM26ayP2PzTXXkUOxadVESDa9lJUCJ/KA==',key_name='tempest-keypair-216914981',keypairs=<?>,launch_index=0,launched_at=2023-11-16T16:01:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-nkwhcl1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T16:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=8d5e667c-3598-4d54-a883-0253873bda01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "4288cc40-1e9f-4b4e-8714-d9485009761f", "address": "fa:16:3e:bc:b8:46", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4288cc40-1e", "ovs_interfaceid": "4288cc40-1e9f-4b4e-8714-d9485009761f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:b8:46,bridge_name='br-int',has_traffic_filtering=True,id=4288cc40-1e9f-4b4e-8714-d9485009761f,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4288cc40-1e') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG os_vif [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:b8:46,bridge_name='br-int',has_traffic_filtering=True,id=4288cc40-1e9f-4b4e-8714-d9485009761f,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4288cc40-1e') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4288cc40-1e, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=815334a4-e558-4b11-a6df-3c0eb07d50a1) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:04:15 user nova-compute[74658]: INFO os_vif [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:b8:46,bridge_name='br-int',has_traffic_filtering=True,id=4288cc40-1e9f-4b4e-8714-d9485009761f,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4288cc40-1e')
Nov 16 16:04:15 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Deleting instance files /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01_del
Nov 16 16:04:15 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Deletion of /opt/stack/data/nova/instances/8d5e667c-3598-4d54-a883-0253873bda01_del complete
Nov 16 16:04:15 user nova-compute[74658]: INFO nova.compute.manager [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 16:04:15 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 16:04:15 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 16:04:16 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:04:16 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Took 0.69 seconds to deallocate network for instance.
Nov 16 16:04:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:04:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:04:16 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:04:16 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:04:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:04:16 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Deleted allocations for instance 8d5e667c-3598-4d54-a883-0253873bda01
Nov 16 16:04:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5a893eb4-dd33-4110-b3bd-fbb15988790d tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "8d5e667c-3598-4d54-a883-0253873bda01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.830s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:04:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-3d55368d-c6db-4707-8ebb-8edbda9d5c2b req-03cba45f-598d-48f7-a7c0-fa0255bb50c6 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Received event network-vif-plugged-4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:04:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3d55368d-c6db-4707-8ebb-8edbda9d5c2b req-03cba45f-598d-48f7-a7c0-fa0255bb50c6 service nova] Acquiring lock "8d5e667c-3598-4d54-a883-0253873bda01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:04:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3d55368d-c6db-4707-8ebb-8edbda9d5c2b req-03cba45f-598d-48f7-a7c0-fa0255bb50c6 service nova] Lock "8d5e667c-3598-4d54-a883-0253873bda01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:04:17 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3d55368d-c6db-4707-8ebb-8edbda9d5c2b req-03cba45f-598d-48f7-a7c0-fa0255bb50c6 service nova] Lock "8d5e667c-3598-4d54-a883-0253873bda01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:04:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-3d55368d-c6db-4707-8ebb-8edbda9d5c2b req-03cba45f-598d-48f7-a7c0-fa0255bb50c6 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] No waiting events found dispatching network-vif-plugged-4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:04:17 user nova-compute[74658]: WARNING nova.compute.manager [req-3d55368d-c6db-4707-8ebb-8edbda9d5c2b req-03cba45f-598d-48f7-a7c0-fa0255bb50c6 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Received unexpected event network-vif-plugged-4288cc40-1e9f-4b4e-8714-d9485009761f for instance with vm_state deleted and task_state None.
Nov 16 16:04:17 user nova-compute[74658]: DEBUG nova.compute.manager [req-3d55368d-c6db-4707-8ebb-8edbda9d5c2b req-03cba45f-598d-48f7-a7c0-fa0255bb50c6 service nova] [instance: 8d5e667c-3598-4d54-a883-0253873bda01] Received event network-vif-deleted-4288cc40-1e9f-4b4e-8714-d9485009761f {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:04:20 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:25 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:30 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:31 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:35 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:04:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:36 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:04:37 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:04:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:04:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 16:04:38 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:04:39 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:04:39 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:04:39 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9217MB free_disk=25.25257110595703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:04:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:04:40 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:04:41 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:04:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:04:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:04:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:04:45 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:04:46 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:04:50 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:04:55 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:05 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:05:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "b5884ecb-be5d-4efb-b657-506c015a94ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 16:05:08 user nova-compute[74658]: INFO nova.compute.claims [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Claim successful on node user
Nov 16 16:05:08 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 16:05:08 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 16:05:08 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 16:05:08 user nova-compute[74658]: DEBUG nova.policy [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b3fb6a56c5847ff8ae46e06544158c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f416cd7c5b4496d8bbf1ee6dad85058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 16:05:09 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Creating image(s)
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "/opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "/opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.189s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk 1073741824" returned: 0 in 0.048s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Cannot resize image /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Ensure instance console log exists: /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:05:09 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Successfully created port: 0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Successfully updated port: 0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquired lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-2a051c55-b8dd-4fd3-aaee-71ca73738fd2 req-cda6c420-420d-4d12-970c-6eec32f93d99 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Received event network-changed-0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG nova.compute.manager [req-2a051c55-b8dd-4fd3-aaee-71ca73738fd2 req-cda6c420-420d-4d12-970c-6eec32f93d99 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Refreshing instance network info cache due to event network-changed-0f292679-bbba-44a0-8dec-62f8e5c6264a. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a051c55-b8dd-4fd3-aaee-71ca73738fd2 req-cda6c420-420d-4d12-970c-6eec32f93d99 service nova] Acquiring lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG nova.network.neutron [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updating instance_info_cache with network_info: [{"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Releasing lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Instance network_info: |[{"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a051c55-b8dd-4fd3-aaee-71ca73738fd2 req-cda6c420-420d-4d12-970c-6eec32f93d99 service nova] Acquired lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG nova.network.neutron [req-2a051c55-b8dd-4fd3-aaee-71ca73738fd2 req-cda6c420-420d-4d12-970c-6eec32f93d99 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Refreshing network info cache for port 0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 16:05:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Start _get_guest_xml network_info=[{"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 16:05:10 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:05:10 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T16:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1392609675',display_name='tempest-AttachVolumeNegativeTest-server-1392609675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1392609675',id=51,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA0yisQHuMRHaA1AeTJi2XiNpHjKuk3zC/1mWLqknkICfBdYH3nsejUPSo9sPD6ZvhH5Stb8Su8jQM6uQ3HUNnD/YanUJ3zqO134o58T1pygwPEQKHKstrD3vi78CovxQ==',key_name='tempest-keypair-571872977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-fftronnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T16:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=b5884ecb-be5d-4efb-b657-506c015a94ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:86,bridge_name='br-int',has_traffic_filtering=True,id=0f292679-bbba-44a0-8dec-62f8e5c6264a,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f292679-bb') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.objects.instance [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'pci_devices' on Instance uuid b5884ecb-be5d-4efb-b657-506c015a94ba {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] End _get_guest_xml xml=<domain type="kvm">
Nov 16 16:05:11 user nova-compute[74658]:   <uuid>b5884ecb-be5d-4efb-b657-506c015a94ba</uuid>
Nov 16 16:05:11 user nova-compute[74658]:   <name>instance-00000033</name>
Nov 16 16:05:11 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 16:05:11 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 16:05:11 user nova-compute[74658]:   <metadata>
Nov 16 16:05:11 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 16:05:11 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 16:05:11 user nova-compute[74658]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1392609675</nova:name>
Nov 16 16:05:11 user nova-compute[74658]:       <nova:creationTime>2023-11-16 16:05:11</nova:creationTime>
Nov 16 16:05:11 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 16:05:11 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 16:05:11 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 16:05:11 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 16:05:11 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 16:05:11 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 16:05:11 user nova-compute[74658]:       </nova:flavor>
Nov 16 16:05:11 user nova-compute[74658]:       <nova:owner>
Nov 16 16:05:11 user nova-compute[74658]:         <nova:user uuid="2b3fb6a56c5847ff8ae46e06544158c7">tempest-AttachVolumeNegativeTest-1769018240-project-member</nova:user>
Nov 16 16:05:11 user nova-compute[74658]:         <nova:project uuid="6f416cd7c5b4496d8bbf1ee6dad85058">tempest-AttachVolumeNegativeTest-1769018240</nova:project>
Nov 16 16:05:11 user nova-compute[74658]:       </nova:owner>
Nov 16 16:05:11 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 16:05:11 user nova-compute[74658]:       <nova:ports>
Nov 16 16:05:11 user nova-compute[74658]:         <nova:port uuid="0f292679-bbba-44a0-8dec-62f8e5c6264a">
Nov 16 16:05:11 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 16:05:11 user nova-compute[74658]:         </nova:port>
Nov 16 16:05:11 user nova-compute[74658]:       </nova:ports>
Nov 16 16:05:11 user nova-compute[74658]:     </nova:instance>
Nov 16 16:05:11 user nova-compute[74658]:   </metadata>
Nov 16 16:05:11 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 16:05:11 user nova-compute[74658]:     <system>
Nov 16 16:05:11 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 16:05:11 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 16:05:11 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 16:05:11 user nova-compute[74658]:       <entry name="serial">b5884ecb-be5d-4efb-b657-506c015a94ba</entry>
Nov 16 16:05:11 user nova-compute[74658]:       <entry name="uuid">b5884ecb-be5d-4efb-b657-506c015a94ba</entry>
Nov 16 16:05:11 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 16:05:11 user nova-compute[74658]:     </system>
Nov 16 16:05:11 user nova-compute[74658]:   </sysinfo>
Nov 16 16:05:11 user nova-compute[74658]:   <os>
Nov 16 16:05:11 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 16:05:11 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 16:05:11 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 16:05:11 user nova-compute[74658]:   </os>
Nov 16 16:05:11 user nova-compute[74658]:   <features>
Nov 16 16:05:11 user nova-compute[74658]:     <acpi/>
Nov 16 16:05:11 user nova-compute[74658]:     <apic/>
Nov 16 16:05:11 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 16:05:11 user nova-compute[74658]:   </features>
Nov 16 16:05:11 user nova-compute[74658]:   <clock offset="utc">
Nov 16 16:05:11 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 16:05:11 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 16:05:11 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 16:05:11 user nova-compute[74658]:   </clock>
Nov 16 16:05:11 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 16:05:11 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 16:05:11 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 16:05:11 user nova-compute[74658]:   </cpu>
Nov 16 16:05:11 user nova-compute[74658]:   <devices>
Nov 16 16:05:11 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 16:05:11 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 16:05:11 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk"/>
Nov 16 16:05:11 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 16:05:11 user nova-compute[74658]:     </disk>
Nov 16 16:05:11 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 16:05:11 user nova-compute[74658]:       <mac address="fa:16:3e:9b:ff:86"/>
Nov 16 16:05:11 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 16:05:11 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 16:05:11 user nova-compute[74658]:       <target dev="tap0f292679-bb"/>
Nov 16 16:05:11 user nova-compute[74658]:     </interface>
Nov 16 16:05:11 user nova-compute[74658]:     <serial type="pty">
Nov 16 16:05:11 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/console.log" append="off"/>
Nov 16 16:05:11 user nova-compute[74658]:     </serial>
Nov 16 16:05:11 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 16:05:11 user nova-compute[74658]:     <video>
Nov 16 16:05:11 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 16:05:11 user nova-compute[74658]:     </video>
Nov 16 16:05:11 user nova-compute[74658]:     <rng model="virtio">
Nov 16 16:05:11 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 16:05:11 user nova-compute[74658]:     </rng>
Nov 16 16:05:11 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 16:05:11 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 16:05:11 user nova-compute[74658]:       <stats period="10"/>
Nov 16 16:05:11 user nova-compute[74658]:     </memballoon>
Nov 16 16:05:11 user nova-compute[74658]:   </devices>
Nov 16 16:05:11 user nova-compute[74658]: </domain>
Nov 16 16:05:11 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T16:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1392609675',display_name='tempest-AttachVolumeNegativeTest-server-1392609675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1392609675',id=51,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA0yisQHuMRHaA1AeTJi2XiNpHjKuk3zC/1mWLqknkICfBdYH3nsejUPSo9sPD6ZvhH5Stb8Su8jQM6uQ3HUNnD/YanUJ3zqO134o58T1pygwPEQKHKstrD3vi78CovxQ==',key_name='tempest-keypair-571872977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-fftronnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T16:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=b5884ecb-be5d-4efb-b657-506c015a94ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:86,bridge_name='br-int',has_traffic_filtering=True,id=0f292679-bbba-44a0-8dec-62f8e5c6264a,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f292679-bb') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG os_vif [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:86,bridge_name='br-int',has_traffic_filtering=True,id=0f292679-bbba-44a0-8dec-62f8e5c6264a,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f292679-bb') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75b37cb9-909d-5e66-b939-ccf0c5aa1e3c', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f292679-bb, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f292679-bb, col_values=(('qos', UUID('cccbb1fe-086e-458c-abab-9de3341a0ab5')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f292679-bb, col_values=(('external_ids', {'iface-id': '0f292679-bbba-44a0-8dec-62f8e5c6264a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:ff:86', 'vm-uuid': 'b5884ecb-be5d-4efb-b657-506c015a94ba'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:11 user nova-compute[74658]: INFO os_vif [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:86,bridge_name='br-int',has_traffic_filtering=True,id=0f292679-bbba-44a0-8dec-62f8e5c6264a,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f292679-bb')
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No VIF found with MAC fa:16:3e:9b:ff:86, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.network.neutron [req-2a051c55-b8dd-4fd3-aaee-71ca73738fd2 req-cda6c420-420d-4d12-970c-6eec32f93d99 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updated VIF entry in instance network info cache for port 0f292679-bbba-44a0-8dec-62f8e5c6264a. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG nova.network.neutron [req-2a051c55-b8dd-4fd3-aaee-71ca73738fd2 req-cda6c420-420d-4d12-970c-6eec32f93d99 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updating instance_info_cache with network_info: [{"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:05:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2a051c55-b8dd-4fd3-aaee-71ca73738fd2 req-cda6c420-420d-4d12-970c-6eec32f93d99 service nova] Releasing lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:05:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-2ee51b95-4449-4ef7-89dc-3987b8c61d2f req-7f21ffd8-4b1e-4ac5-b29a-09138e3f5a2a service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Received event network-vif-plugged-0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:05:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2ee51b95-4449-4ef7-89dc-3987b8c61d2f req-7f21ffd8-4b1e-4ac5-b29a-09138e3f5a2a service nova] Acquiring lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:05:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2ee51b95-4449-4ef7-89dc-3987b8c61d2f req-7f21ffd8-4b1e-4ac5-b29a-09138e3f5a2a service nova] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:05:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-2ee51b95-4449-4ef7-89dc-3987b8c61d2f req-7f21ffd8-4b1e-4ac5-b29a-09138e3f5a2a service nova] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:05:12 user nova-compute[74658]: DEBUG nova.compute.manager [req-2ee51b95-4449-4ef7-89dc-3987b8c61d2f req-7f21ffd8-4b1e-4ac5-b29a-09138e3f5a2a service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] No waiting events found dispatching network-vif-plugged-0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:05:12 user nova-compute[74658]: WARNING nova.compute.manager [req-2ee51b95-4449-4ef7-89dc-3987b8c61d2f req-7f21ffd8-4b1e-4ac5-b29a-09138e3f5a2a service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Received unexpected event network-vif-plugged-0f292679-bbba-44a0-8dec-62f8e5c6264a for instance with vm_state building and task_state spawning.
Nov 16 16:05:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:12 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 16:05:14 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Instance spawned successfully.
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:05:14 user nova-compute[74658]: INFO nova.compute.manager [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 16:05:14 user nova-compute[74658]: INFO nova.compute.manager [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Took 6.02 seconds to build instance.
Nov 16 16:05:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1991a217-630e-4e99-9bc5-3150580e2b51 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.115s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-30b076ec-3962-4e25-a526-6bf5a5afaeee req-5a6efbdc-5ea8-4e97-a852-2709903fa1e9 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Received event network-vif-plugged-0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-30b076ec-3962-4e25-a526-6bf5a5afaeee req-5a6efbdc-5ea8-4e97-a852-2709903fa1e9 service nova] Acquiring lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-30b076ec-3962-4e25-a526-6bf5a5afaeee req-5a6efbdc-5ea8-4e97-a852-2709903fa1e9 service nova] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-30b076ec-3962-4e25-a526-6bf5a5afaeee req-5a6efbdc-5ea8-4e97-a852-2709903fa1e9 service nova] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:05:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-30b076ec-3962-4e25-a526-6bf5a5afaeee req-5a6efbdc-5ea8-4e97-a852-2709903fa1e9 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] No waiting events found dispatching network-vif-plugged-0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:05:14 user nova-compute[74658]: WARNING nova.compute.manager [req-30b076ec-3962-4e25-a526-6bf5a5afaeee req-5a6efbdc-5ea8-4e97-a852-2709903fa1e9 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Received unexpected event network-vif-plugged-0f292679-bbba-44a0-8dec-62f8e5c6264a for instance with vm_state active and task_state None.
Nov 16 16:05:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:05:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:32 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:05:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:05:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:05:36 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:05:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:37 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:05:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:05:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:05:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:05:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:05:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 16:05:37 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid b5884ecb-be5d-4efb-b657-506c015a94ba {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:05:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updating instance_info_cache with network_info: [{"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:05:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:05:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 16:05:37 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:05:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:05:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:05:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:05:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:05:39 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:05:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:05:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:05:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:05:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:05:40 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:05:40 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:05:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9083MB free_disk=25.22307586669922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:05:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:05:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:05:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance b5884ecb-be5d-4efb-b657-506c015a94ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 16:05:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:05:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:05:40 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:05:40 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:05:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:05:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:05:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:41 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:05:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:42 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:05:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:48 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:05:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:05:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:05:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:05:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:05:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:05:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:05:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:06:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:06:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:06:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:06:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:06:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:06:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:06:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:06:34 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:06:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid b5884ecb-be5d-4efb-b657-506c015a94ba {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updating instance_info_cache with network_info: [{"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:06:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:06:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:06:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:06:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:06:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:06:39 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:06:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:06:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:06:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:06:39 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:06:40 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:06:40 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:06:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9110MB free_disk=25.22234344482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:06:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:06:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:06:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance b5884ecb-be5d-4efb-b657-506c015a94ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 16:06:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:06:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:06:40 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:06:40 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:06:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:06:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:06:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:41 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:06:43 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:06:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:06:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:06:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:06:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:06:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:06:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:06:59 user nova-compute[74658]: DEBUG nova.compute.manager [req-63af7adf-b3bd-49d5-ba8d-25e596b3f60b req-144985a0-bfcd-4271-80df-c2234f77f708 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Received event network-changed-0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:06:59 user nova-compute[74658]: DEBUG nova.compute.manager [req-63af7adf-b3bd-49d5-ba8d-25e596b3f60b req-144985a0-bfcd-4271-80df-c2234f77f708 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Refreshing instance network info cache due to event network-changed-0f292679-bbba-44a0-8dec-62f8e5c6264a. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 16:06:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-63af7adf-b3bd-49d5-ba8d-25e596b3f60b req-144985a0-bfcd-4271-80df-c2234f77f708 service nova] Acquiring lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:06:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-63af7adf-b3bd-49d5-ba8d-25e596b3f60b req-144985a0-bfcd-4271-80df-c2234f77f708 service nova] Acquired lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:06:59 user nova-compute[74658]: DEBUG nova.network.neutron [req-63af7adf-b3bd-49d5-ba8d-25e596b3f60b req-144985a0-bfcd-4271-80df-c2234f77f708 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Refreshing network info cache for port 0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 16:06:59 user nova-compute[74658]: DEBUG nova.network.neutron [req-63af7adf-b3bd-49d5-ba8d-25e596b3f60b req-144985a0-bfcd-4271-80df-c2234f77f708 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updated VIF entry in instance network info cache for port 0f292679-bbba-44a0-8dec-62f8e5c6264a. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 16:06:59 user nova-compute[74658]: DEBUG nova.network.neutron [req-63af7adf-b3bd-49d5-ba8d-25e596b3f60b req-144985a0-bfcd-4271-80df-c2234f77f708 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updating instance_info_cache with network_info: [{"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:06:59 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-63af7adf-b3bd-49d5-ba8d-25e596b3f60b req-144985a0-bfcd-4271-80df-c2234f77f708 service nova] Releasing lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:07:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "b5884ecb-be5d-4efb-b657-506c015a94ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG nova.objects.instance [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'flavor' on Instance uuid b5884ecb-be5d-4efb-b657-506c015a94ba {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "b5884ecb-be5d-4efb-b657-506c015a94ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:07:02 user nova-compute[74658]: INFO nova.compute.manager [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Attaching volume 6e7ee304-26ae-4478-b52e-466ee1c1fddd to /dev/vdb
Nov 16 16:07:02 user nova-compute[74658]: DEBUG os_brick.utils [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[194f4dab-32ca-451b-be9c-8fd50a049721]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[54846c88-9de4-4f66-8e2e-40edf36e323b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f6ad4e-7db2-4c86-905d-8137946d6ae8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aab9c4f-73bd-4acb-82aa-d93a7917c7a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 16:07:02 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 16:07:02 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d749b84-6f61-4648-bf7e-1aaba86a2a67]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG os_brick.utils [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:07:02 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updating existing volume attachment record: 52db4899-4cc3-44d3-b200-8cefda73a098 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 16:07:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNgczjyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:07:07 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:07:07 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:07:07 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e9bdc9-c141-4cba-a27a-c9b64db50d89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 16:07:07 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac90a4bb-6054-471c-b1cc-4ee6e3220b29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd] added
Nov 16 16:07:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2527622a-4c32-4812-8fe5-54f6579ff114]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea30d98c-b43c-4865-bad7-b2c9d6859a8f]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNgczjyB {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNgczjyB" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9017c43b-b3d8-4a28-a84d-47d4d4a5e018]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oNgczjyB'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05c522e-6d93-4d26-a605-fd1827879764]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[148087f2-54c7-4fbb-ad60-27daf9071f6d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 16:07:07 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 16:07:07 user nova-compute[74658]:  {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:07:07 user nova-compute[74658]: WARNING os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 16:07:07 user nova-compute[74658]: 
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14df44f-b244-41c7-a14d-791db7124a22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd, portal: 172.16.0.220,3260]
Nov 16 16:07:07 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd, portal: 172.16.0.220,3260] successful.
Nov 16 16:07:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c55afb3-7a45-4cf9-8e47-8a43f6b917ce]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1608512c-0ef2-4ce2-b669-8c205fcf181a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd (non-flash)
Nov 16 16:07:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd (non-flash)
Nov 16 16:07:07 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5770d2-0082-4dcb-be96-3374a32d2a3f]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:07 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 16:07:08 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 16:07:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNgczjyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 16:07:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:07:08 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23232613238663963', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:07:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232613238663963', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 16:07:08 user nova-compute[74658]: DEBUG nova.objects.instance [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'flavor' on Instance uuid b5884ecb-be5d-4efb-b657-506c015a94ba {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:07:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 16:07:08 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:07:08 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 16:07:08 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 16:07:08 user nova-compute[74658]:   <serial>6e7ee304-26ae-4478-b52e-466ee1c1fddd</serial>
Nov 16 16:07:08 user nova-compute[74658]: </disk>
Nov 16 16:07:08 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 16:07:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:07:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:07:08 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] No VIF found with MAC fa:16:3e:9b:ff:86, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 16:07:08 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-7d79fbd5-5754-4426-8a8b-e899ad1e5822 tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.637s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:07:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "b5884ecb-be5d-4efb-b657-506c015a94ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:07:10 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:07:10 user nova-compute[74658]: INFO nova.compute.manager [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Detaching volume 6e7ee304-26ae-4478-b52e-466ee1c1fddd
Nov 16 16:07:10 user nova-compute[74658]: INFO nova.virt.block_device [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Attempting to driver detach volume 6e7ee304-26ae-4478-b52e-466ee1c1fddd from mountpoint /dev/vdb
Nov 16 16:07:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Attempting to detach device vdb from instance b5884ecb-be5d-4efb-b657-506c015a94ba from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 16:07:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 16:07:10 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:07:10 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 16:07:10 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 16:07:10 user nova-compute[74658]:   <serial>6e7ee304-26ae-4478-b52e-466ee1c1fddd</serial>
Nov 16 16:07:10 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 16:07:10 user nova-compute[74658]: </disk>
Nov 16 16:07:10 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 16:07:10 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully detached device vdb from instance b5884ecb-be5d-4efb-b657-506c015a94ba from the persistent domain config.
Nov 16 16:07:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5884ecb-be5d-4efb-b657-506c015a94ba from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 16:07:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 16:07:10 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:07:10 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 16:07:10 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 16:07:10 user nova-compute[74658]:   <serial>6e7ee304-26ae-4478-b52e-466ee1c1fddd</serial>
Nov 16 16:07:10 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 16:07:10 user nova-compute[74658]: </disk>
Nov 16 16:07:10 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 16:07:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5884ecb-be5d-4efb-b657-506c015a94ba {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 16:07:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:07:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:07:30 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5884ecb-be5d-4efb-b657-506c015a94ba is timed out.
Nov 16 16:07:30 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully detached device vdb from instance b5884ecb-be5d-4efb-b657-506c015a94ba from the live domain config.
Nov 16 16:07:30 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNgczjyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:07:30 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[e348d093-7d4a-40c0-a994-2ef360b552cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 16:07:30 user nova-compute[74658]: No targets found.
Nov 16 16:07:30 user nova-compute[74658]: iSNS:
Nov 16 16:07:30 user nova-compute[74658]: No targets found.
Nov 16 16:07:30 user nova-compute[74658]: STATIC:
Nov 16 16:07:30 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd
Nov 16 16:07:30 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 16:07:30 user nova-compute[74658]:                 Iface Name: default
Nov 16 16:07:30 user nova-compute[74658]: FIRMWARE:
Nov 16 16:07:30 user nova-compute[74658]: No targets found.
Nov 16 16:07:30 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 16:07:30 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 16:07:30 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea84dd1-d585-4adf-b754-3fd7d31b570d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c8d453-e4ca-4a9d-b034-feca8bcf9c01]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd (non-flash)
Nov 16 16:07:30 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd (non-flash)
Nov 16 16:07:30 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f073c98bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acf389d-aba0-4044-abef-a9aa20043fee]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbb2fc3-0add-45a7-bfdd-030ce61d0847]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e817fe-32df-42ad-82ca-ff447b6efa96]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 16:07:30 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0479aa-24a8-42d2-a445-5b07455f6a3d]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1e72fb-441b-48b1-8a46-f4df91d07bd2]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da3c231-2461-4208-b062-383b195d4bb0]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd, portal: 172.16.0.220,3260]
Nov 16 16:07:31 user nova-compute[74658]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd, portal: 172.16.0.220,3260] successful.
Nov 16 16:07:31 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e7ee304-26ae-4478-b52e-466ee1c1fddd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa04ed8-d7b6-4e2e-bbd6-4866fd0e2505]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] <== disconnect_volume: return (310ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG nova.objects.instance [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'flavor' on Instance uuid b5884ecb-be5d-4efb-b657-506c015a94ba {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:07:31 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-8dc05b23-b81c-47d2-aa47-0bfe0116f24e tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.620s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:07:33 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:07:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:07:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:37 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:07:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:07:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:07:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:07:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:07:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 16:07:37 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid b5884ecb-be5d-4efb-b657-506c015a94ba {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:07:37 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updating instance_info_cache with network_info: [{"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:07:37 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-b5884ecb-be5d-4efb-b657-506c015a94ba" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:07:37 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 16:07:38 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:07:38 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:07:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:07:40 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:07:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:07:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:07:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:07:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:07:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:07:40 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:07:41 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:07:41 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:07:41 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9076MB free_disk=25.221233367919922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance b5884ecb-be5d-4efb-b657-506c015a94ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:07:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:07:42 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:07:43 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:07:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:07:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:07:52 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:07:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "b5884ecb-be5d-4efb-b657-506c015a94ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:08:00 user nova-compute[74658]: INFO nova.compute.manager [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Terminating instance
Nov 16 16:08:00 user nova-compute[74658]: DEBUG nova.compute.manager [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-24a27fb1-2569-4dfa-8812-db3aefa4e1e0 req-d4e1f4f5-1fe9-416a-bd54-03abde2d91b8 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Received event network-vif-unplugged-0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24a27fb1-2569-4dfa-8812-db3aefa4e1e0 req-d4e1f4f5-1fe9-416a-bd54-03abde2d91b8 service nova] Acquiring lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24a27fb1-2569-4dfa-8812-db3aefa4e1e0 req-d4e1f4f5-1fe9-416a-bd54-03abde2d91b8 service nova] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-24a27fb1-2569-4dfa-8812-db3aefa4e1e0 req-d4e1f4f5-1fe9-416a-bd54-03abde2d91b8 service nova] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-24a27fb1-2569-4dfa-8812-db3aefa4e1e0 req-d4e1f4f5-1fe9-416a-bd54-03abde2d91b8 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] No waiting events found dispatching network-vif-unplugged-0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:08:00 user nova-compute[74658]: DEBUG nova.compute.manager [req-24a27fb1-2569-4dfa-8812-db3aefa4e1e0 req-d4e1f4f5-1fe9-416a-bd54-03abde2d91b8 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Received event network-vif-unplugged-0f292679-bbba-44a0-8dec-62f8e5c6264a for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Instance destroyed successfully.
Nov 16 16:08:01 user nova-compute[74658]: DEBUG nova.objects.instance [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lazy-loading 'resources' on Instance uuid b5884ecb-be5d-4efb-b657-506c015a94ba {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T16:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1392609675',display_name='tempest-AttachVolumeNegativeTest-server-1392609675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1392609675',id=51,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA0yisQHuMRHaA1AeTJi2XiNpHjKuk3zC/1mWLqknkICfBdYH3nsejUPSo9sPD6ZvhH5Stb8Su8jQM6uQ3HUNnD/YanUJ3zqO134o58T1pygwPEQKHKstrD3vi78CovxQ==',key_name='tempest-keypair-571872977',keypairs=<?>,launch_index=0,launched_at=2023-11-16T16:05:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f416cd7c5b4496d8bbf1ee6dad85058',ramdisk_id='',reservation_id='r-fftronnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1769018240',owner_user_name='tempest-AttachVolumeNegativeTest-1769018240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T16:05:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b3fb6a56c5847ff8ae46e06544158c7',uuid=b5884ecb-be5d-4efb-b657-506c015a94ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converting VIF {"id": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "address": "fa:16:3e:9b:ff:86", "network": {"id": "35ce0d96-a061-4bf5-81cd-e4a7772e1893", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1917134013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f416cd7c5b4496d8bbf1ee6dad85058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f292679-bb", "ovs_interfaceid": "0f292679-bbba-44a0-8dec-62f8e5c6264a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:ff:86,bridge_name='br-int',has_traffic_filtering=True,id=0f292679-bbba-44a0-8dec-62f8e5c6264a,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f292679-bb') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG os_vif [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:ff:86,bridge_name='br-int',has_traffic_filtering=True,id=0f292679-bbba-44a0-8dec-62f8e5c6264a,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f292679-bb') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f292679-bb, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cccbb1fe-086e-458c-abab-9de3341a0ab5) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:01 user nova-compute[74658]: INFO os_vif [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:ff:86,bridge_name='br-int',has_traffic_filtering=True,id=0f292679-bbba-44a0-8dec-62f8e5c6264a,network=Network(35ce0d96-a061-4bf5-81cd-e4a7772e1893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f292679-bb')
Nov 16 16:08:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Deleting instance files /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba_del
Nov 16 16:08:01 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Deletion of /opt/stack/data/nova/instances/b5884ecb-be5d-4efb-b657-506c015a94ba_del complete
Nov 16 16:08:01 user nova-compute[74658]: INFO nova.compute.manager [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 16:08:01 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 16:08:01 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 16:08:02 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:08:02 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Took 0.72 seconds to deallocate network for instance.
Nov 16 16:08:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-56a3fd1d-f267-471b-ad10-a794acfedcc5 req-d876e663-eaeb-4856-97aa-00f6208ae83c service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Received event network-vif-deleted-0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:08:02 user nova-compute[74658]: INFO nova.compute.manager [req-56a3fd1d-f267-471b-ad10-a794acfedcc5 req-d876e663-eaeb-4856-97aa-00f6208ae83c service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Neutron deleted interface 0f292679-bbba-44a0-8dec-62f8e5c6264a; detaching it from the instance and deleting it from the info cache
Nov 16 16:08:02 user nova-compute[74658]: DEBUG nova.network.neutron [req-56a3fd1d-f267-471b-ad10-a794acfedcc5 req-d876e663-eaeb-4856-97aa-00f6208ae83c service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:08:02 user nova-compute[74658]: DEBUG nova.compute.manager [req-56a3fd1d-f267-471b-ad10-a794acfedcc5 req-d876e663-eaeb-4856-97aa-00f6208ae83c service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Detach interface failed, port_id=0f292679-bbba-44a0-8dec-62f8e5c6264a, reason: Instance b5884ecb-be5d-4efb-b657-506c015a94ba could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 16:08:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:08:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:08:02 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:08:02 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:08:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:08:02 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Deleted allocations for instance b5884ecb-be5d-4efb-b657-506c015a94ba
Nov 16 16:08:02 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-cfd55ac0-bbfd-43ac-9418-12de93c142eb tempest-AttachVolumeNegativeTest-1769018240 tempest-AttachVolumeNegativeTest-1769018240-project-member] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.896s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:08:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-64e3785f-6506-4517-ab4d-a1ecb18191d0 req-e86f94ad-d75c-47ee-8616-fb60f9b2d0a5 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Received event network-vif-plugged-0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:08:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-64e3785f-6506-4517-ab4d-a1ecb18191d0 req-e86f94ad-d75c-47ee-8616-fb60f9b2d0a5 service nova] Acquiring lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:08:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-64e3785f-6506-4517-ab4d-a1ecb18191d0 req-e86f94ad-d75c-47ee-8616-fb60f9b2d0a5 service nova] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:08:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-64e3785f-6506-4517-ab4d-a1ecb18191d0 req-e86f94ad-d75c-47ee-8616-fb60f9b2d0a5 service nova] Lock "b5884ecb-be5d-4efb-b657-506c015a94ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:08:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-64e3785f-6506-4517-ab4d-a1ecb18191d0 req-e86f94ad-d75c-47ee-8616-fb60f9b2d0a5 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] No waiting events found dispatching network-vif-plugged-0f292679-bbba-44a0-8dec-62f8e5c6264a {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:08:03 user nova-compute[74658]: WARNING nova.compute.manager [req-64e3785f-6506-4517-ab4d-a1ecb18191d0 req-e86f94ad-d75c-47ee-8616-fb60f9b2d0a5 service nova] [instance: b5884ecb-be5d-4efb-b657-506c015a94ba] Received unexpected event network-vif-plugged-0f292679-bbba-44a0-8dec-62f8e5c6264a for instance with vm_state deleted and task_state None.
Nov 16 16:08:05 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:08:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:08:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:08:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:08:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:34 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:08:35 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:08:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:38 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:08:38 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:08:38 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:08:38 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 16:08:38 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:08:38 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:08:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:08:40 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:08:40 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:08:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9223MB free_disk=25.248531341552734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 16:08:40 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 16:08:41 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 16:08:41 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:08:41 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:08:41 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:08:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:08:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:42 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:08:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 16:08:43 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:08:44 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:08:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:08:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:08:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:08:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:08:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:08:54 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:08:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:00 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:09:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:17 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:09:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 16:09:17 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 16:09:19 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:09:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:09:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:09:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:09:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:09:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:31 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:34 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:09:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:09:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:09:38 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:09:38 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:09:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:09:39 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:09:39 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:09:39 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:09:40 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:09:40 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:09:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9210MB free_disk=25.23812484741211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:09:40 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:09:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:09:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:09:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:09:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:09:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:44 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:09:45 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:09:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:09:51 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:56 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:09:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:09:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:09:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:09:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:09:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:09:56 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:09 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:10:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:10:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:10:12 user nova-compute[74658]: DEBUG nova.compute.manager [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Starting instance... {{(pid=74658) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 16:10:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:10:12 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:10:12 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74658) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 16:10:12 user nova-compute[74658]: INFO nova.compute.claims [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Claim successful on node user
Nov 16 16:10:13 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Start building networks asynchronously for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Allocating IP information in the background. {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] allocate_for_instance() {{(pid=74658) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 16:10:13 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 16:10:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Start building block device mappings for instance. {{(pid=74658) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG nova.policy [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e31a3ac8d2bb4b79beb24aa43e527c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad7d5f341824a0593ef5a6f5fc99cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74658) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG nova.compute.manager [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Start spawning the instance on the hypervisor. {{(pid=74658) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Creating instance directory {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 16:10:13 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Creating image(s)
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "/opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "/opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk 1073741824 {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2,backing_fmt=raw /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk 1073741824" returned: 0 in 0.057s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "adbba702242cf0ca20cfe480b6995a2b8dff66a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG nova.network.neutron [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Successfully created port: 3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adbba702242cf0ca20cfe480b6995a2b8dff66a2 --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk. size=1073741824 {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 16:10:13 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.disk.api [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Cannot resize image /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk to a smaller size. {{(pid=74658) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Created local disks {{(pid=74658) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Ensure instance console log exists: /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/console.log {{(pid=74658) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.network.neutron [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Successfully updated port: 3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquired lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.network.neutron [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Building network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.network.neutron [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Instance cache missing network info. {{(pid=74658) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-0dde8b2e-43cc-4945-8cd2-b88c79d7d95a req-fd6db671-01ec-443c-9c4e-861b9b5f7e3d service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Received event network-changed-3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.compute.manager [req-0dde8b2e-43cc-4945-8cd2-b88c79d7d95a req-fd6db671-01ec-443c-9c4e-861b9b5f7e3d service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Refreshing instance network info cache due to event network-changed-3eb2833e-c298-407f-8c8e-1c1d5c9355ac. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0dde8b2e-43cc-4945-8cd2-b88c79d7d95a req-fd6db671-01ec-443c-9c4e-861b9b5f7e3d service nova] Acquiring lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.network.neutron [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updating instance_info_cache with network_info: [{"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Releasing lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.compute.manager [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Instance network_info: |[{"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74658) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0dde8b2e-43cc-4945-8cd2-b88c79d7d95a req-fd6db671-01ec-443c-9c4e-861b9b5f7e3d service nova] Acquired lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.network.neutron [req-0dde8b2e-43cc-4945-8cd2-b88c79d7d95a req-fd6db671-01ec-443c-9c4e-861b9b5f7e3d service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Refreshing network info cache for port 3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Start _get_guest_xml network_info=[{"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'aca440dd-4b6f-4e54-990c-d8198a375081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 16:10:14 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:10:14 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] CPU controller missing on host. {{(pid=74658) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.host [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] CPU controller found on host. {{(pid=74658) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74658) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T15:13:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T15:13:18Z,direct_url=<?>,disk_format='qcow2',id=aca440dd-4b6f-4e54-990c-d8198a375081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6485794c78ee4e53a265b2e22a843590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T15:13:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Flavor limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Image limits 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Flavor pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Image pref 0:0:0 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Got 1 possible topologies {{(pid=74658) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.hardware [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74658) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T16:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-958017717',display_name='tempest-TestServerVolumeAttachmentScenario-server-958017717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-958017717',id=52,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxzItUDM43+FWPgYJRdxHUbe3czI2kvC6m8Dvw5JBP2OKulpm9BRd21wu/eK5o5455gU3iuArH5dN/hc/rnxDUjohmrkWgDVWnIM2zYhMP5Ss1Do9jPpfYXe+gHcVkLTQ==',key_name='tempest-keypair-1883669563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad7d5f341824a0593ef5a6f5fc99cd2',ramdisk_id='',reservation_id='r-b7x6517t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1180812455',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1180812455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T16:10:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31a3ac8d2bb4b79beb24aa43e527c2c',uuid=5a21d67c-4cc0-4492-9acb-c841516d93e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74658) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Converting VIF {"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e4:72,bridge_name='br-int',has_traffic_filtering=True,id=3eb2833e-c298-407f-8c8e-1c1d5c9355ac,network=Network(70ffb60d-e092-49f9-85e0-26a5df936025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb2833e-c2') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.objects.instance [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 16:10:14 user nova-compute[74658]:   <uuid>5a21d67c-4cc0-4492-9acb-c841516d93e9</uuid>
Nov 16 16:10:14 user nova-compute[74658]:   <name>instance-00000034</name>
Nov 16 16:10:14 user nova-compute[74658]:   <memory>524288</memory>
Nov 16 16:10:14 user nova-compute[74658]:   <vcpu>1</vcpu>
Nov 16 16:10:14 user nova-compute[74658]:   <metadata>
Nov 16 16:10:14 user nova-compute[74658]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 16:10:14 user nova-compute[74658]:       <nova:package version="0.0.0"/>
Nov 16 16:10:14 user nova-compute[74658]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-958017717</nova:name>
Nov 16 16:10:14 user nova-compute[74658]:       <nova:creationTime>2023-11-16 16:10:14</nova:creationTime>
Nov 16 16:10:14 user nova-compute[74658]:       <nova:flavor name="m1.tiny">
Nov 16 16:10:14 user nova-compute[74658]:         <nova:memory>512</nova:memory>
Nov 16 16:10:14 user nova-compute[74658]:         <nova:disk>1</nova:disk>
Nov 16 16:10:14 user nova-compute[74658]:         <nova:swap>0</nova:swap>
Nov 16 16:10:14 user nova-compute[74658]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 16:10:14 user nova-compute[74658]:         <nova:vcpus>1</nova:vcpus>
Nov 16 16:10:14 user nova-compute[74658]:       </nova:flavor>
Nov 16 16:10:14 user nova-compute[74658]:       <nova:owner>
Nov 16 16:10:14 user nova-compute[74658]:         <nova:user uuid="e31a3ac8d2bb4b79beb24aa43e527c2c">tempest-TestServerVolumeAttachmentScenario-1180812455-project-member</nova:user>
Nov 16 16:10:14 user nova-compute[74658]:         <nova:project uuid="0ad7d5f341824a0593ef5a6f5fc99cd2">tempest-TestServerVolumeAttachmentScenario-1180812455</nova:project>
Nov 16 16:10:14 user nova-compute[74658]:       </nova:owner>
Nov 16 16:10:14 user nova-compute[74658]:       <nova:root type="image" uuid="aca440dd-4b6f-4e54-990c-d8198a375081"/>
Nov 16 16:10:14 user nova-compute[74658]:       <nova:ports>
Nov 16 16:10:14 user nova-compute[74658]:         <nova:port uuid="3eb2833e-c298-407f-8c8e-1c1d5c9355ac">
Nov 16 16:10:14 user nova-compute[74658]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 16:10:14 user nova-compute[74658]:         </nova:port>
Nov 16 16:10:14 user nova-compute[74658]:       </nova:ports>
Nov 16 16:10:14 user nova-compute[74658]:     </nova:instance>
Nov 16 16:10:14 user nova-compute[74658]:   </metadata>
Nov 16 16:10:14 user nova-compute[74658]:   <sysinfo type="smbios">
Nov 16 16:10:14 user nova-compute[74658]:     <system>
Nov 16 16:10:14 user nova-compute[74658]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 16:10:14 user nova-compute[74658]:       <entry name="product">OpenStack Nova</entry>
Nov 16 16:10:14 user nova-compute[74658]:       <entry name="version">0.0.0</entry>
Nov 16 16:10:14 user nova-compute[74658]:       <entry name="serial">5a21d67c-4cc0-4492-9acb-c841516d93e9</entry>
Nov 16 16:10:14 user nova-compute[74658]:       <entry name="uuid">5a21d67c-4cc0-4492-9acb-c841516d93e9</entry>
Nov 16 16:10:14 user nova-compute[74658]:       <entry name="family">Virtual Machine</entry>
Nov 16 16:10:14 user nova-compute[74658]:     </system>
Nov 16 16:10:14 user nova-compute[74658]:   </sysinfo>
Nov 16 16:10:14 user nova-compute[74658]:   <os>
Nov 16 16:10:14 user nova-compute[74658]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 16:10:14 user nova-compute[74658]:     <boot dev="hd"/>
Nov 16 16:10:14 user nova-compute[74658]:     <smbios mode="sysinfo"/>
Nov 16 16:10:14 user nova-compute[74658]:   </os>
Nov 16 16:10:14 user nova-compute[74658]:   <features>
Nov 16 16:10:14 user nova-compute[74658]:     <acpi/>
Nov 16 16:10:14 user nova-compute[74658]:     <apic/>
Nov 16 16:10:14 user nova-compute[74658]:     <vmcoreinfo/>
Nov 16 16:10:14 user nova-compute[74658]:   </features>
Nov 16 16:10:14 user nova-compute[74658]:   <clock offset="utc">
Nov 16 16:10:14 user nova-compute[74658]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 16:10:14 user nova-compute[74658]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 16:10:14 user nova-compute[74658]:     <timer name="hpet" present="no"/>
Nov 16 16:10:14 user nova-compute[74658]:   </clock>
Nov 16 16:10:14 user nova-compute[74658]:   <cpu mode="custom" match="exact">
Nov 16 16:10:14 user nova-compute[74658]:     <model>Nehalem</model>
Nov 16 16:10:14 user nova-compute[74658]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 16:10:14 user nova-compute[74658]:   </cpu>
Nov 16 16:10:14 user nova-compute[74658]:   <devices>
Nov 16 16:10:14 user nova-compute[74658]:     <disk type="file" device="disk">
Nov 16 16:10:14 user nova-compute[74658]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 16:10:14 user nova-compute[74658]:       <source file="/opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk"/>
Nov 16 16:10:14 user nova-compute[74658]:       <target dev="vda" bus="virtio"/>
Nov 16 16:10:14 user nova-compute[74658]:     </disk>
Nov 16 16:10:14 user nova-compute[74658]:     <interface type="ethernet">
Nov 16 16:10:14 user nova-compute[74658]:       <mac address="fa:16:3e:1d:e4:72"/>
Nov 16 16:10:14 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 16:10:14 user nova-compute[74658]:       <mtu size="1442"/>
Nov 16 16:10:14 user nova-compute[74658]:       <target dev="tap3eb2833e-c2"/>
Nov 16 16:10:14 user nova-compute[74658]:     </interface>
Nov 16 16:10:14 user nova-compute[74658]:     <serial type="pty">
Nov 16 16:10:14 user nova-compute[74658]:       <log file="/opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/console.log" append="off"/>
Nov 16 16:10:14 user nova-compute[74658]:     </serial>
Nov 16 16:10:14 user nova-compute[74658]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 16:10:14 user nova-compute[74658]:     <video>
Nov 16 16:10:14 user nova-compute[74658]:       <model type="virtio"/>
Nov 16 16:10:14 user nova-compute[74658]:     </video>
Nov 16 16:10:14 user nova-compute[74658]:     <rng model="virtio">
Nov 16 16:10:14 user nova-compute[74658]:       <backend model="random">/dev/urandom</backend>
Nov 16 16:10:14 user nova-compute[74658]:     </rng>
Nov 16 16:10:14 user nova-compute[74658]:     <controller type="usb" index="0" model="none"/>
Nov 16 16:10:14 user nova-compute[74658]:     <memballoon model="virtio">
Nov 16 16:10:14 user nova-compute[74658]:       <stats period="10"/>
Nov 16 16:10:14 user nova-compute[74658]:     </memballoon>
Nov 16 16:10:14 user nova-compute[74658]:   </devices>
Nov 16 16:10:14 user nova-compute[74658]: </domain>
Nov 16 16:10:14 user nova-compute[74658]:  {{(pid=74658) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T16:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-958017717',display_name='tempest-TestServerVolumeAttachmentScenario-server-958017717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-958017717',id=52,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxzItUDM43+FWPgYJRdxHUbe3czI2kvC6m8Dvw5JBP2OKulpm9BRd21wu/eK5o5455gU3iuArH5dN/hc/rnxDUjohmrkWgDVWnIM2zYhMP5Ss1Do9jPpfYXe+gHcVkLTQ==',key_name='tempest-keypair-1883669563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad7d5f341824a0593ef5a6f5fc99cd2',ramdisk_id='',reservation_id='r-b7x6517t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1180812455',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1180812455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T16:10:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31a3ac8d2bb4b79beb24aa43e527c2c',uuid=5a21d67c-4cc0-4492-9acb-c841516d93e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Converting VIF {"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e4:72,bridge_name='br-int',has_traffic_filtering=True,id=3eb2833e-c298-407f-8c8e-1c1d5c9355ac,network=Network(70ffb60d-e092-49f9-85e0-26a5df936025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb2833e-c2') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG os_vif [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e4:72,bridge_name='br-int',has_traffic_filtering=True,id=3eb2833e-c298-407f-8c8e-1c1d5c9355ac,network=Network(70ffb60d-e092-49f9-85e0-26a5df936025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb2833e-c2') {{(pid=74658) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19a3bd97-5f84-5baa-89f7-bdf25079d580', '_type': 'linux-noop'}}, row=False) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3eb2833e-c2, may_exist=True, interface_attrs={}) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3eb2833e-c2, col_values=(('qos', UUID('7200db3e-35f5-4e8b-9672-41c33cc7899c')),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3eb2833e-c2, col_values=(('external_ids', {'iface-id': '3eb2833e-c298-407f-8c8e-1c1d5c9355ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:e4:72', 'vm-uuid': '5a21d67c-4cc0-4492-9acb-c841516d93e9'}),), if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:14 user nova-compute[74658]: INFO os_vif [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e4:72,bridge_name='br-int',has_traffic_filtering=True,id=3eb2833e-c298-407f-8c8e-1c1d5c9355ac,network=Network(70ffb60d-e092-49f9-85e0-26a5df936025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb2833e-c2')
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:10:14 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] No VIF found with MAC fa:16:3e:1d:e4:72, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 16:10:15 user nova-compute[74658]: DEBUG nova.network.neutron [req-0dde8b2e-43cc-4945-8cd2-b88c79d7d95a req-fd6db671-01ec-443c-9c4e-861b9b5f7e3d service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updated VIF entry in instance network info cache for port 3eb2833e-c298-407f-8c8e-1c1d5c9355ac. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 16:10:15 user nova-compute[74658]: DEBUG nova.network.neutron [req-0dde8b2e-43cc-4945-8cd2-b88c79d7d95a req-fd6db671-01ec-443c-9c4e-861b9b5f7e3d service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updating instance_info_cache with network_info: [{"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:10:15 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-0dde8b2e-43cc-4945-8cd2-b88c79d7d95a req-fd6db671-01ec-443c-9c4e-861b9b5f7e3d service nova] Releasing lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:10:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-1eeefc0c-5934-4e32-a488-c6e431b3dc7e req-c13ca47d-0b39-4d53-a819-cf7edc9e337e service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Received event network-vif-plugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:10:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1eeefc0c-5934-4e32-a488-c6e431b3dc7e req-c13ca47d-0b39-4d53-a819-cf7edc9e337e service nova] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:10:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1eeefc0c-5934-4e32-a488-c6e431b3dc7e req-c13ca47d-0b39-4d53-a819-cf7edc9e337e service nova] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:10:16 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-1eeefc0c-5934-4e32-a488-c6e431b3dc7e req-c13ca47d-0b39-4d53-a819-cf7edc9e337e service nova] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:10:16 user nova-compute[74658]: DEBUG nova.compute.manager [req-1eeefc0c-5934-4e32-a488-c6e431b3dc7e req-c13ca47d-0b39-4d53-a819-cf7edc9e337e service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] No waiting events found dispatching network-vif-plugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:10:16 user nova-compute[74658]: WARNING nova.compute.manager [req-1eeefc0c-5934-4e32-a488-c6e431b3dc7e req-c13ca47d-0b39-4d53-a819-cf7edc9e337e service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Received unexpected event network-vif-plugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac for instance with vm_state building and task_state spawning.
Nov 16 16:10:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:16 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.compute.manager [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Instance event wait completed in 0 seconds for  {{(pid=74658) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Guest created on hypervisor {{(pid=74658) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 16:10:18 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Instance spawned successfully.
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Found default for hw_cdrom_bus of ide {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Found default for hw_disk_bus of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Found default for hw_input_bus of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Found default for hw_pointer_model of None {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Found default for hw_video_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Found default for hw_vif_model of virtio {{(pid=74658) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 16:10:18 user nova-compute[74658]: INFO nova.compute.manager [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.compute.manager [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Checking state {{(pid=74658) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 16:10:18 user nova-compute[74658]: INFO nova.compute.manager [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Took 5.47 seconds to build instance.
Nov 16 16:10:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-557ade33-a064-415d-b568-55561ed4b38c tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.568s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-5932292f-554c-4f5b-aa93-0700ab0febe1 req-e7f2083b-2b64-4d35-8f70-de5cdd568c6a service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Received event network-vif-plugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5932292f-554c-4f5b-aa93-0700ab0febe1 req-e7f2083b-2b64-4d35-8f70-de5cdd568c6a service nova] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5932292f-554c-4f5b-aa93-0700ab0febe1 req-e7f2083b-2b64-4d35-8f70-de5cdd568c6a service nova] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-5932292f-554c-4f5b-aa93-0700ab0febe1 req-e7f2083b-2b64-4d35-8f70-de5cdd568c6a service nova] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:10:18 user nova-compute[74658]: DEBUG nova.compute.manager [req-5932292f-554c-4f5b-aa93-0700ab0febe1 req-e7f2083b-2b64-4d35-8f70-de5cdd568c6a service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] No waiting events found dispatching network-vif-plugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:10:18 user nova-compute[74658]: WARNING nova.compute.manager [req-5932292f-554c-4f5b-aa93-0700ab0febe1 req-e7f2083b-2b64-4d35-8f70-de5cdd568c6a service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Received unexpected event network-vif-plugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac for instance with vm_state active and task_state None.
Nov 16 16:10:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:26 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:10:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:38 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:10:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:10:39 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:10:39 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:10:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:10:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:10:39 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 16:10:39 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:10:39 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updating instance_info_cache with network_info: [{"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:10:39 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:10:39 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 16:10:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:40 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:10:40 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:10:40 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:10:41 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:42 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:10:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:10:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:10:42 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:10:42 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:10:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:10:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:10:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:10:42 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:10:43 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:10:43 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:10:43 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9094MB free_disk=25.207210540771484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:10:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:10:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:10:43 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 16:10:43 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:10:43 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:10:43 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:10:43 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:10:43 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:10:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:10:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:46 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:10:46 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:10:46 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:10:58 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:10:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:11:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:11:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:11:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:11:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:11:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:11:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:11:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:11:36 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:11:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:11:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:11:41 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:11:41 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:11:41 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:11:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:11:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:11:41 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 16:11:41 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:11:41 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updating instance_info_cache with network_info: [{"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:11:41 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:11:41 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 16:11:42 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:11:42 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:11:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:11:43 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:11:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:11:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:11:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:11:43 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:11:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:11:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:11:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:11:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:11:43 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:11:43 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:11:43 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9077MB free_disk=25.206451416015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:11:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:11:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:11:44 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 16:11:44 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:11:44 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:11:44 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:11:44 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:11:44 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:11:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:11:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:11:48 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:11:48 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:11:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:11:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:11:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:12:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-3791ccbe-463f-413f-ae2e-924f514b7345 req-e1904ab2-17e3-4078-a491-236079254c82 service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Received event network-changed-3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:12:03 user nova-compute[74658]: DEBUG nova.compute.manager [req-3791ccbe-463f-413f-ae2e-924f514b7345 req-e1904ab2-17e3-4078-a491-236079254c82 service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Refreshing instance network info cache due to event network-changed-3eb2833e-c298-407f-8c8e-1c1d5c9355ac. {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 16:12:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3791ccbe-463f-413f-ae2e-924f514b7345 req-e1904ab2-17e3-4078-a491-236079254c82 service nova] Acquiring lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:12:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3791ccbe-463f-413f-ae2e-924f514b7345 req-e1904ab2-17e3-4078-a491-236079254c82 service nova] Acquired lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:12:03 user nova-compute[74658]: DEBUG nova.network.neutron [req-3791ccbe-463f-413f-ae2e-924f514b7345 req-e1904ab2-17e3-4078-a491-236079254c82 service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Refreshing network info cache for port 3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG nova.network.neutron [req-3791ccbe-463f-413f-ae2e-924f514b7345 req-e1904ab2-17e3-4078-a491-236079254c82 service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updated VIF entry in instance network info cache for port 3eb2833e-c298-407f-8c8e-1c1d5c9355ac. {{(pid=74658) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG nova.network.neutron [req-3791ccbe-463f-413f-ae2e-924f514b7345 req-e1904ab2-17e3-4078-a491-236079254c82 service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updating instance_info_cache with network_info: [{"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-3791ccbe-463f-413f-ae2e-924f514b7345 req-e1904ab2-17e3-4078-a491-236079254c82 service nova] Releasing lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lazy-loading 'flavor' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:12:04 user nova-compute[74658]: INFO nova.compute.manager [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Attaching volume e5ab0851-7f25-4cd7-92b8-190c59a80b29 to /dev/vdb
Nov 16 16:12:04 user nova-compute[74658]: DEBUG os_brick.utils [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b60c775-e62c-4679-8eff-96e0d678514b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3f5f69-5e36-4840-8a93-8179ad0c0a90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3741cc42-1c81-420f-b99c-66e7182d8e69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9632a872-1f01-4dc4-a2cb-722bcc817402]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 16:12:04 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:05 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 16:12:05 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 16:12:05 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e66649-82d0-4581-b22f-65d3b3a15e45]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 16:12:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 16:12:05 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 16:12:05 user nova-compute[74658]: DEBUG os_brick.utils [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:12:05 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updating existing volume attachment record: fd08c049-4800-4936-bf69-f799aa170261 {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 16:12:06 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOWgcloU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:12:09 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:12:09 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:12:09 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[971c3f3e-8f22-4277-9fe7-bcefe8046a34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 16:12:09 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63929a7-77b3-419d-955c-3adf383bcd2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29] added
Nov 16 16:12:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[48714eb9-47b7-4de2-9153-965f200943e8]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e83b87-09ca-4b4a-9f78-3d4b2374dd31]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOWgcloU {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOWgcloU" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff48be2e-6e04-4f0a-8b8b-f455fddf7f90]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XOWgcloU'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e725380-8ffb-4486-b44d-58cb54a87044]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d165219-df40-4fc5-9c1e-f6e2a1e66a09]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 16:12:09 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 16:12:09 user nova-compute[74658]:  {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:12:09 user nova-compute[74658]: WARNING os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 16:12:09 user nova-compute[74658]: 
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c51707-ae60-4482-abd1-bd8eb66a646e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29, portal: 172.16.0.220,3260]
Nov 16 16:12:09 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29, portal: 172.16.0.220,3260] successful.
Nov 16 16:12:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c688fca-2a2c-48ef-937b-88da9b3f7522]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[77102905-b8b6-4e13-8352-acd72166d0b8]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)
Nov 16 16:12:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)
Nov 16 16:12:09 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[2105f9f2-c832-4813-acb2-c18819ace46e]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:09 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 16:12:10 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:12:10 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 16:12:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOWgcloU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 16:12:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:12:10 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26366386661633335', 'path': '/dev/sdb'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:12:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366386661633335', 'path': '/dev/sdb'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 16:12:10 user nova-compute[74658]: DEBUG nova.objects.instance [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lazy-loading 'flavor' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:12:10 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 16:12:10 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:12:10 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 16:12:10 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 16:12:10 user nova-compute[74658]:   <serial>e5ab0851-7f25-4cd7-92b8-190c59a80b29</serial>
Nov 16 16:12:10 user nova-compute[74658]: </disk>
Nov 16 16:12:10 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 16:12:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:12:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:12:11 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] No VIF found with MAC fa:16:3e:1d:e4:72, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 16:12:11 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:11 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-ec8e18f2-50c1-4750-b3a9-82b73a6fc601 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.657s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:12:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:12:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:12:14 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lazy-loading 'flavor' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:12:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:12:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:12:14 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:12:14 user nova-compute[74658]: INFO nova.compute.manager [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Attaching volume 3f4b872f-462b-48b9-b138-d767bf036275 to /dev/vdc
Nov 16 16:12:15 user nova-compute[74658]: DEBUG os_brick.utils [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc8dde0-7185-4081-9cec-bf3e12aea546]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2aa49f7bf0dc\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[693965be-cad3-4fcb-be5b-16b34e2c4163]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f070a3c-8383-48eb-8e61-2e062fff6999]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b48aee8-0dd3-49e0-95ad-4743dd0a2c0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Running cmd (subprocess): nvme version {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] 'nvme version' failed. Not Retrying. {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] nvme not present on system {{(pid=74658) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 16:12:15 user nova-compute[74658]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 16:12:15 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3796d42-e4d3-407b-a8ff-932f3e7f6a78]: (4, '') {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74658) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.lightos [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] LIGHTOS: no hostnqn found. {{(pid=74658) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG os_brick.utils [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2aa49f7bf0dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:12:15 user nova-compute[74658]: DEBUG nova.virt.block_device [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updating existing volume attachment record: 6af50738-32e7-4607-bccd-514c25cf435b {{(pid=74658) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Calling os-brick to attach iSCSI Volume {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDbWMekl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:12:19 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:12:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:12:19 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:12:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:12:19 user nova-compute[74658]: INFO os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ba8616-8082-4490-80b3-7edbbf060ad5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 16:12:19 user nova-compute[74658]:  {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --interface default --op new {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e59188-c375-4676-a072-a0ef6c1f9b39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275] added\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275] added
Nov 16 16:12:19 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9566eb0f-65bc-4dc4-a7c1-045a46fb7444]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69fb332-56ef-472e-b887-507133c4c646]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDbWMekl {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDbWMekl" returned: 0 in 0.017s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[899aaced-dbc6-40c2-b873-37934ca32be0]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cDbWMekl'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:19 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ec6643-3a6a-4ba3-8c46-51481fd3f46e]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f068dc-2e36-4dc0-b5fb-edbe24218d79]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)
Nov 16 16:12:20 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)
Nov 16 16:12:20 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --login {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[761b9657-04c0-4bc4-be15-0d8c2811ff6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275, portal: 172.16.0.220,3260]
Nov 16 16:12:20 user nova-compute[74658]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275, portal: 172.16.0.220,3260] successful.
Nov 16 16:12:20 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b7d9a1-d25b-4537-9ad5-e7fd0ed25752]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e633983-4fb8-4e8d-975f-33e61666202b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)
Nov 16 16:12:20 user nova-compute[74658]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 (non-flash)
Nov 16 16:12:20 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)
Nov 16 16:12:20 user nova-compute[74658]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 (non-flash)
Nov 16 16:12:20 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Connected to 172.16.0.220:3260 {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=74658) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74658) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5488ec-304c-4bb2-9cea-349d0b66b81d]: (4, ('- - 0', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:20 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: None {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74658) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDbWMekl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74658) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26133353061323633', 'path': '/dev/sdc'} {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133353061323633', 'path': '/dev/sdc'} {{(pid=74658) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG nova.objects.instance [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lazy-loading 'flavor' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 16:12:21 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:12:21 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 16:12:21 user nova-compute[74658]:   <target dev="vdc" bus="virtio"/>
Nov 16 16:12:21 user nova-compute[74658]:   <serial>3f4b872f-462b-48b9-b138-d767bf036275</serial>
Nov 16 16:12:21 user nova-compute[74658]: </disk>
Nov 16 16:12:21 user nova-compute[74658]:  {{(pid=74658) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74658) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] No VIF found with MAC fa:16:3e:1d:e4:72, not building metadata {{(pid=74658) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 16:12:21 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-5ffbcabc-9d66-4038-9ca9-3a809ac4689a tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.744s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:12:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:12:22 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:12:22 user nova-compute[74658]: INFO nova.compute.manager [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Detaching volume 3f4b872f-462b-48b9-b138-d767bf036275
Nov 16 16:12:22 user nova-compute[74658]: INFO nova.virt.block_device [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Attempting to driver detach volume 3f4b872f-462b-48b9-b138-d767bf036275 from mountpoint /dev/vdc
Nov 16 16:12:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Attempting to detach device vdc from instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 16:12:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 16:12:22 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:12:22 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 16:12:22 user nova-compute[74658]:   <target dev="vdc" bus="virtio"/>
Nov 16 16:12:22 user nova-compute[74658]:   <serial>3f4b872f-462b-48b9-b138-d767bf036275</serial>
Nov 16 16:12:22 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 16:12:22 user nova-compute[74658]: </disk>
Nov 16 16:12:22 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 16:12:22 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Successfully detached device vdc from instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 from the persistent domain config.
Nov 16 16:12:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 16:12:22 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 16:12:22 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:12:22 user nova-compute[74658]:   <source dev="/dev/sdc"/>
Nov 16 16:12:22 user nova-compute[74658]:   <target dev="vdc" bus="virtio"/>
Nov 16 16:12:22 user nova-compute[74658]:   <serial>3f4b872f-462b-48b9-b138-d767bf036275</serial>
Nov 16 16:12:22 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 16:12:22 user nova-compute[74658]: </disk>
Nov 16 16:12:22 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 16:12:23 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 16:12:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:36 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:38 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:12:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:12:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:42 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:12:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:12:43 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 is timed out.
Nov 16 16:12:43 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Successfully detached device vdc from instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 from the live domain config.
Nov 16 16:12:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDbWMekl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:12:43 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0f39a7-acee-46b6-8aaa-176dc61cfb32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 16:12:43 user nova-compute[74658]: No targets found.
Nov 16 16:12:43 user nova-compute[74658]: iSNS:
Nov 16 16:12:43 user nova-compute[74658]: No targets found.
Nov 16 16:12:43 user nova-compute[74658]: STATIC:
Nov 16 16:12:43 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275
Nov 16 16:12:43 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 16:12:43 user nova-compute[74658]:                 Iface Name: default
Nov 16 16:12:43 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29
Nov 16 16:12:43 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 16:12:43 user nova-compute[74658]:                 Iface Name: default
Nov 16 16:12:43 user nova-compute[74658]: FIRMWARE:
Nov 16 16:12:43 user nova-compute[74658]: No targets found.
Nov 16 16:12:43 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 16:12:43 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 16:12:43 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42ed965-cabd-4212-8471-86b63924ae5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bca5122-8d62-43ed-a29d-90a4dc2c87fd]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)
Nov 16 16:12:43 user nova-compute[74658]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 (non-flash)
Nov 16 16:12:43 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)
Nov 16 16:12:43 user nova-compute[74658]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 (non-flash)
Nov 16 16:12:43 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07101bae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275'): ({'sdc'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Removing single pathed devices sdc {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c12320-d7ef-44a1-96bd-78a438417d4e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3536725-9558-4bb0-a234-3b41a251daea]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Flushing IO for device /dev/sdc {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb546a9-99d4-437b-8ace-5d1184461a65]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fac722-09f5-4747-8013-d156c24a54f7]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] SCSI volumes sdc have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee5fb02-ecaf-4695-958b-2197d67a005b]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[248bdec2-1849-437e-b6c2-47e28d7af9a4]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275, portal: 172.16.0.220,3260]
Nov 16 16:12:43 user nova-compute[74658]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275, portal: 172.16.0.220,3260] successful.
Nov 16 16:12:43 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4b872f-462b-48b9-b138-d767bf036275 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[420d58b8-2dde-44b3-aa28-3364d74c7740]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] <== disconnect_volume: return (326ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updating instance_info_cache with network_info: [{"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 16:12:43 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:12:44 user nova-compute[74658]: DEBUG nova.objects.instance [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lazy-loading 'flavor' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:12:44 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-07ac209f-d21f-40be-8117-4596a553ffbc tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.652s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:12:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:12:45 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:12:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:12:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:12:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:12:45 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:12:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:12:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:12:45 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74658) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 16:12:46 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:12:46 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:12:46 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9036MB free_disk=25.20489501953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:12:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:12:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:12:46 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 16:12:46 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:12:46 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:12:46 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:12:46 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:12:46 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:12:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:12:48 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:12:48 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:12:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:12:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:12:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:13:00 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:13:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:13:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:13:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:13:13 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:13:13 user nova-compute[74658]: INFO nova.compute.manager [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Detaching volume e5ab0851-7f25-4cd7-92b8-190c59a80b29
Nov 16 16:13:13 user nova-compute[74658]: INFO nova.virt.block_device [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Attempting to driver detach volume e5ab0851-7f25-4cd7-92b8-190c59a80b29 from mountpoint /dev/vdb
Nov 16 16:13:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Attempting to detach device vdb from instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 from the persistent domain config. {{(pid=74658) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 16:13:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 16:13:13 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:13:13 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 16:13:13 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 16:13:13 user nova-compute[74658]:   <serial>e5ab0851-7f25-4cd7-92b8-190c59a80b29</serial>
Nov 16 16:13:13 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 16:13:13 user nova-compute[74658]: </disk>
Nov 16 16:13:13 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 16:13:13 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Successfully detached device vdb from instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 from the persistent domain config.
Nov 16 16:13:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 from the live domain config. {{(pid=74658) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 16:13:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.guest [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 16:13:13 user nova-compute[74658]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 16:13:13 user nova-compute[74658]:   <source dev="/dev/sdb"/>
Nov 16 16:13:13 user nova-compute[74658]:   <target dev="vdb" bus="virtio"/>
Nov 16 16:13:13 user nova-compute[74658]:   <serial>e5ab0851-7f25-4cd7-92b8-190c59a80b29</serial>
Nov 16 16:13:13 user nova-compute[74658]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 16:13:13 user nova-compute[74658]: </disk>
Nov 16 16:13:13 user nova-compute[74658]:  {{(pid=74658) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 16:13:13 user nova-compute[74658]: DEBUG nova.virt.libvirt.driver [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 16:13:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:13:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:13:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:13:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:13:33 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 is timed out.
Nov 16 16:13:33 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Successfully detached device vdb from instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 from the live domain config.
Nov 16 16:13:33 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] calling os-brick to detach iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f071078c040>, {'target_iqn': 'iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOWgcloU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 16:13:33 user nova-compute[74658]: WARNING os_brick.initiator.connectors.base [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 16:13:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[717171de-7fa3-45bb-b5b8-41a23fabd4bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 16:13:33 user nova-compute[74658]: No targets found.
Nov 16 16:13:33 user nova-compute[74658]: iSNS:
Nov 16 16:13:33 user nova-compute[74658]: No targets found.
Nov 16 16:13:33 user nova-compute[74658]: STATIC:
Nov 16 16:13:33 user nova-compute[74658]: Target: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29
Nov 16 16:13:33 user nova-compute[74658]:         Portal: 172.16.0.220:3260,-1
Nov 16 16:13:33 user nova-compute[74658]:                 Iface Name: default
Nov 16 16:13:33 user nova-compute[74658]: FIRMWARE:
Nov 16 16:13:33 user nova-compute[74658]: No targets found.
Nov 16 16:13:33 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 16:13:33 user nova-compute[74658]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 16:13:33 user nova-compute[74658]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74658) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29', 0)] {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ad21df-5368-4fb2-b9bb-ed19b49a93b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d5376-7f06-4f5d-be01-0a9c4ef88e58]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)
Nov 16 16:13:33 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 (non-flash)
Nov 16 16:13:33 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07101b84c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29'): ({'sdb'}, set())}) {{(pid=74658) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Removing single pathed devices sdb {{(pid=74658) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c366427-ef0c-4828-9015-6ffe07f8be6e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf63fe0-e07c-4f2f-83a2-ef71a4ff3576]: (4, ('ok\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Flushing IO for device /dev/sdb {{(pid=74658) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 16:13:33 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68938da-264d-4f0d-a056-8ae5d1c4c628]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74658) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb44e82a-4382-437a-b973-4011fdf8e754]: (4, ('1', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG os_brick.initiator.linuxscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] SCSI volumes sdb have been removed. {{(pid=74658) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29')] {{(pid=74658) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e95549-07e8-46ef-920c-e0d14f71d738]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --logout {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b36b0f-88d8-43cf-921f-13eb52d2adef]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29, portal: 172.16.0.220,3260]
Nov 16 16:13:34 user nova-compute[74658]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29, portal: 172.16.0.220,3260] successful.
Nov 16 16:13:34 user nova-compute[74658]:  stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op delete {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ab0851-7f25-4cd7-92b8-190c59a80b29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f55832d-b490-4ccb-a93e-638435153e68]: (4, ('', '')) {{(pid=84815) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74658) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.base [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG os_brick.initiator.connectors.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] <== disconnect_volume: return (296ms) None {{(pid=74658) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Disconnected iSCSI Volume {{(pid=74658) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG nova.objects.instance [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lazy-loading 'flavor' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:13:34 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-451704b7-1ef3-4000-8a66-64863f268935 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.580s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:13:38 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:13:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:13:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:13:42 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:13:42 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances with incomplete migration  {{(pid=74658) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 16:13:43 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:13:43 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:13:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquired lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Forcefully refreshing network info cache for instance {{(pid=74658) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG nova.objects.instance [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lazy-loading 'info_cache' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG nova.network.neutron [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updating instance_info_cache with network_info: [{"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Releasing lock "refresh_cache-5a21d67c-4cc0-4492-9acb-c841516d93e9" {{(pid=74658) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updated the network info_cache for instance {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:45 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG oslo_concurrency.processutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 16:13:46 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:13:46 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=25.204242706298828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74658) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing inventories for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating ProviderTree inventory for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Updating inventory in ProviderTree for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing aggregate associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, aggregates: None {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Refreshing trait associations for resource provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74658) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:13:46 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:13:48 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:13:49 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:13:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:13:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:13:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:02 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:14:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:14:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:14:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:14:03 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:14:03 user nova-compute[74658]: INFO nova.compute.manager [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Terminating instance
Nov 16 16:14:03 user nova-compute[74658]: DEBUG nova.compute.manager [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Start destroying the instance on the hypervisor. {{(pid=74658) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 16:14:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:03 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-6e4c2271-9be6-4221-bf8c-960b9002bdbc req-f8f87449-a2f5-42d8-8a48-52b5a5ab3dcf service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Received event network-vif-unplugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6e4c2271-9be6-4221-bf8c-960b9002bdbc req-f8f87449-a2f5-42d8-8a48-52b5a5ab3dcf service nova] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6e4c2271-9be6-4221-bf8c-960b9002bdbc req-f8f87449-a2f5-42d8-8a48-52b5a5ab3dcf service nova] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-6e4c2271-9be6-4221-bf8c-960b9002bdbc req-f8f87449-a2f5-42d8-8a48-52b5a5ab3dcf service nova] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-6e4c2271-9be6-4221-bf8c-960b9002bdbc req-f8f87449-a2f5-42d8-8a48-52b5a5ab3dcf service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] No waiting events found dispatching network-vif-unplugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG nova.compute.manager [req-6e4c2271-9be6-4221-bf8c-960b9002bdbc req-f8f87449-a2f5-42d8-8a48-52b5a5ab3dcf service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Received event network-vif-unplugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac for instance with task_state deleting. {{(pid=74658) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [-] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Instance destroyed successfully.
Nov 16 16:14:04 user nova-compute[74658]: DEBUG nova.objects.instance [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lazy-loading 'resources' on Instance uuid 5a21d67c-4cc0-4492-9acb-c841516d93e9 {{(pid=74658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG nova.virt.libvirt.vif [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T16:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-958017717',display_name='tempest-TestServerVolumeAttachmentScenario-server-958017717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-958017717',id=52,image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxzItUDM43+FWPgYJRdxHUbe3czI2kvC6m8Dvw5JBP2OKulpm9BRd21wu/eK5o5455gU3iuArH5dN/hc/rnxDUjohmrkWgDVWnIM2zYhMP5Ss1Do9jPpfYXe+gHcVkLTQ==',key_name='tempest-keypair-1883669563',keypairs=<?>,launch_index=0,launched_at=2023-11-16T16:10:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ad7d5f341824a0593ef5a6f5fc99cd2',ramdisk_id='',reservation_id='r-b7x6517t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aca440dd-4b6f-4e54-990c-d8198a375081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1180812455',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1180812455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T16:10:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31a3ac8d2bb4b79beb24aa43e527c2c',uuid=5a21d67c-4cc0-4492-9acb-c841516d93e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Converting VIF {"id": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "address": "fa:16:3e:1d:e4:72", "network": {"id": "70ffb60d-e092-49f9-85e0-26a5df936025", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1697210401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad7d5f341824a0593ef5a6f5fc99cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb2833e-c2", "ovs_interfaceid": "3eb2833e-c298-407f-8c8e-1c1d5c9355ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG nova.network.os_vif_util [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:e4:72,bridge_name='br-int',has_traffic_filtering=True,id=3eb2833e-c298-407f-8c8e-1c1d5c9355ac,network=Network(70ffb60d-e092-49f9-85e0-26a5df936025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb2833e-c2') {{(pid=74658) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG os_vif [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:e4:72,bridge_name='br-int',has_traffic_filtering=True,id=3eb2833e-c298-407f-8c8e-1c1d5c9355ac,network=Network(70ffb60d-e092-49f9-85e0-26a5df936025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb2833e-c2') {{(pid=74658) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3eb2833e-c2, bridge=br-int, if_exists=True) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7200db3e-35f5-4e8b-9672-41c33cc7899c) {{(pid=74658) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:14:04 user nova-compute[74658]: INFO os_vif [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:e4:72,bridge_name='br-int',has_traffic_filtering=True,id=3eb2833e-c298-407f-8c8e-1c1d5c9355ac,network=Network(70ffb60d-e092-49f9-85e0-26a5df936025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb2833e-c2')
Nov 16 16:14:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Deleting instance files /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9_del
Nov 16 16:14:04 user nova-compute[74658]: INFO nova.virt.libvirt.driver [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Deletion of /opt/stack/data/nova/instances/5a21d67c-4cc0-4492-9acb-c841516d93e9_del complete
Nov 16 16:14:04 user nova-compute[74658]: INFO nova.compute.manager [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 16:14:04 user nova-compute[74658]: DEBUG oslo.service.loopingcall [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74658) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG nova.compute.manager [-] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Deallocating network for instance {{(pid=74658) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 16:14:04 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] deallocate_for_instance() {{(pid=74658) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 16:14:05 user nova-compute[74658]: DEBUG nova.network.neutron [-] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:14:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-e2d0258d-3973-4a6d-883a-16c1569208c0 req-a21e16f8-7f40-4e7f-bade-77608233b413 service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Received event network-vif-deleted-3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:14:05 user nova-compute[74658]: INFO nova.compute.manager [req-e2d0258d-3973-4a6d-883a-16c1569208c0 req-a21e16f8-7f40-4e7f-bade-77608233b413 service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Neutron deleted interface 3eb2833e-c298-407f-8c8e-1c1d5c9355ac; detaching it from the instance and deleting it from the info cache
Nov 16 16:14:05 user nova-compute[74658]: DEBUG nova.network.neutron [req-e2d0258d-3973-4a6d-883a-16c1569208c0 req-a21e16f8-7f40-4e7f-bade-77608233b413 service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Updating instance_info_cache with network_info: [] {{(pid=74658) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 16:14:05 user nova-compute[74658]: INFO nova.compute.manager [-] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Took 1.20 seconds to deallocate network for instance.
Nov 16 16:14:05 user nova-compute[74658]: DEBUG nova.compute.manager [req-e2d0258d-3973-4a6d-883a-16c1569208c0 req-a21e16f8-7f40-4e7f-bade-77608233b413 service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Detach interface failed, port_id=3eb2833e-c298-407f-8c8e-1c1d5c9355ac, reason: Instance 5a21d67c-4cc0-4492-9acb-c841516d93e9 could not be found. {{(pid=74658) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 16:14:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:14:05 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:14:05 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:14:05 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:14:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:14:06 user nova-compute[74658]: INFO nova.scheduler.client.report [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Deleted allocations for instance 5a21d67c-4cc0-4492-9acb-c841516d93e9
Nov 16 16:14:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-432611cb-d2e2-4d7a-a813-4fa37bec18ad req-d41f5d5a-19be-4e69-bf0e-5b85b34d501a service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Received event network-vif-plugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 16:14:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-432611cb-d2e2-4d7a-a813-4fa37bec18ad req-d41f5d5a-19be-4e69-bf0e-5b85b34d501a service nova] Acquiring lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:14:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-432611cb-d2e2-4d7a-a813-4fa37bec18ad req-d41f5d5a-19be-4e69-bf0e-5b85b34d501a service nova] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:14:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [req-432611cb-d2e2-4d7a-a813-4fa37bec18ad req-d41f5d5a-19be-4e69-bf0e-5b85b34d501a service nova] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:14:06 user nova-compute[74658]: DEBUG nova.compute.manager [req-432611cb-d2e2-4d7a-a813-4fa37bec18ad req-d41f5d5a-19be-4e69-bf0e-5b85b34d501a service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] No waiting events found dispatching network-vif-plugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac {{(pid=74658) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 16:14:06 user nova-compute[74658]: WARNING nova.compute.manager [req-432611cb-d2e2-4d7a-a813-4fa37bec18ad req-d41f5d5a-19be-4e69-bf0e-5b85b34d501a service nova] [instance: 5a21d67c-4cc0-4492-9acb-c841516d93e9] Received unexpected event network-vif-plugged-3eb2833e-c298-407f-8c8e-1c1d5c9355ac for instance with vm_state deleted and task_state None.
Nov 16 16:14:06 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-1764b491-15a7-4408-a43b-a23828108397 tempest-TestServerVolumeAttachmentScenario-1180812455 tempest-TestServerVolumeAttachmentScenario-1180812455-project-member] Lock "5a21d67c-4cc0-4492-9acb-c841516d93e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.344s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:14:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:11 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:14:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:14:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:14:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:14:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:14:21 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Cleaning up deleted instances {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 16:14:21 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] There are 0 instances to clean {{(pid=74658) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 16:14:23 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:14:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:14:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:14:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:14:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:25 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:26 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._sync_power_states {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:29 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:14:34 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:14:39 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:39 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:14:40 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:44 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74658) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager.update_available_resource {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Auditing locally available compute resources for user (node: user) {{(pid=74658) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 16:14:45 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:14:45 user nova-compute[74658]: WARNING nova.virt.libvirt.driver [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 16:14:45 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Hypervisor/Node resource view: name=user free_ram=9197MB free_disk=25.231517791748047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74658) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74658) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG nova.compute.provider_tree [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed in ProviderTree for provider: 16aee638-e9e1-41bd-94a9-c6d2aeb81dee {{(pid=74658) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG nova.scheduler.client.report [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Inventory has not changed for provider 16aee638-e9e1-41bd-94a9-c6d2aeb81dee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74658) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG nova.compute.resource_tracker [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Compute_service record updated for user:user {{(pid=74658) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 16:14:45 user nova-compute[74658]: DEBUG oslo_concurrency.lockutils [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=74658) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 16:14:47 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:47 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Starting heal instance info cache {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 16:14:47 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Rebuilding the list of instances to heal {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 16:14:47 user nova-compute[74658]: DEBUG nova.compute.manager [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Didn't find any instances for network info cache update. {{(pid=74658) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 16:14:49 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:49 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:14:50 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:14:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:54 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:14:59 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:15:01 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:15:03 user nova-compute[74658]: DEBUG oslo_service.periodic_task [None req-0a6b0204-f154-487f-8466-42f85f4c05fb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74658) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 16:15:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:15:04 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:15:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:15:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:15:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:15:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:15:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:15:09 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:15:14 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:15:19 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:15:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 16:15:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 16:15:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74658) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 16:15:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:15:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74658) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 16:15:24 user nova-compute[74658]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74658) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}